-- Logs begin at Tue 2022-09-13 15:29:16 UTC, end at Tue 2022-09-13 16:56:06 UTC. -- Sep 13 15:58:21.992569 dv-cinder-820027-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 15:58:22.001786 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 15:58:22 2022] *** Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: nodename: dv-cinder-820027-28-iscsi Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: machine: x86_64 Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: clock source: unix Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: pcre jit disabled Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: detected number of CPU cores: 4 Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: current working directory: / Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: detected binary path: /usr/bin/uwsgi-core Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: your processes number limit is 47680 Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: your memory page size is 4096 bytes Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: detected max file descriptor number: 2048 Sep 13 15:58:22.003874 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: lock engine: pthread robust mutexes Sep 13 15:58:22.004784 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: thunder lock: enabled Sep 13 15:58:22.004784 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 15:58:22.004784 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 15:58:22.044870 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: Python main interpreter initialized at 0x55579de0e9c0 Sep 13 15:58:22.044870 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: python threads support enabled Sep 13 15:58:22.044870 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: your server socket listen backlog is limited to 100 connections Sep 13 15:58:22.044870 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: your mercy for graceful operations on workers is 90 seconds Sep 13 15:58:22.045245 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 15:58:22.045321 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: *** Operational MODE: preforking *** Sep 13 15:58:22.045547 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: *** uWSGI is running in multiple interpreter mode *** Sep 13 15:58:22.045547 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: spawned uWSGI master process (pid: 105646) Sep 13 15:58:22.045743 dv-cinder-820027-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 15:58:22.048137 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: spawned uWSGI worker 1 (pid: 105647, cores: 1) Sep 13 15:58:22.048137 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: spawned uWSGI worker 2 (pid: 105648, cores: 1) Sep 13 15:58:22.048137 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 15:58:22.709675 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 15:58:22.710294 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 15:58:23.809391 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:58:23.809391 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: from cryptography.utils import int_from_bytes Sep 13 15:58:23.810096 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:58:23.810096 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: from cryptography.utils import int_from_bytes Sep 13 15:58:23.812326 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:58:23.812326 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: from cryptography.utils import int_from_bytes Sep 13 15:58:23.812779 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:58:23.812779 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: from cryptography.utils import int_from_bytes Sep 13 15:58:26.302197 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:58:26.302859 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:58:26.302994 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:58:26.303341 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:58:26.303597 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:58:26.303988 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.304177 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:58:26.304577 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.304678 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:58:26.304773 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.304927 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.305019 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:58:26.305259 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.305356 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:58:26.305523 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:58:26.305627 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.305878 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.305965 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.306198 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.306296 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.306520 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.306607 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.306779 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.306865 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.307119 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.307224 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.307446 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-28-iscsi {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.307535 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.307771 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.307865 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.308101 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.308200 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.308414 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.308728 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.308842 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.308982 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.309088 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.309297 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.309385 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.309623 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-28-iscsi {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.309709 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.309945 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.310118 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.310252 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311296 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311433 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311555 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311658 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311745 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311825 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.311825 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312032 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312118 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312252 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312252 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312483 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312580 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312662 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312748 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.312914 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313008 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313184 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313348 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313484 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313670 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-28-iscsi {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313761 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.313988 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.314087 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.314309 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.314447 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.314608 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.314695 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.314988 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.315089 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.315296 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.315386 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.315637 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.315782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-28-iscsi {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.315960 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.316063 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.316278 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.316366 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.316586 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.316674 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.316918 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317005 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317241 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317338 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317561 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317648 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317878 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.317971 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.318180 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.318285 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.318490 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.318575 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.318798 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.318884 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.319146 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.319247 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.319454 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.319541 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.319760 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.319847 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320010 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320110 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320320 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320415 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320639 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320733 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.320957 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321046 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321261 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321367 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321515 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321602 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321766 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.321863 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.322085 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.322181 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.322401 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.322497 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.322709 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.322802 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.323042 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.323135 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.323292 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.323390 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.323541 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.324157 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.324516 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.324660 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.324827 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.325092 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.325188 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.325399 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.325505 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.325720 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.325817 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326025 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326123 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326335 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326486 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326641 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326739 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.326971 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327062 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327279 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327377 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327585 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327689 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327902 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.327990 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.328216 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.328304 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.328534 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.328623 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.328838 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.328927 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.329156 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.329249 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.329478 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.329568 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.329782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.329870 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.330088 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.330176 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.330393 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.330481 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.330718 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.330806 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331049 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331140 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331367 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331457 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331616 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331702 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.331921 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332023 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332228 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332316 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332549 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332650 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332857 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.332957 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.333165 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.333253 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.333471 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.333557 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.333717 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.333820 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334016 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334110 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334319 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334420 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334640 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334749 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.334964 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.335068 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.335269 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.335363 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.335572 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.335661 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.335873 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336015 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336185 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336328 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336472 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336619 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336760 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.336894 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337028 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337161 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337325 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337470 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337616 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337750 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.337914 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338060 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338206 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338350 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338486 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338620 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338793 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.338956 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.339135 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.339270 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.340048 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.340200 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.340382 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.340694 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.340848 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341137 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341313 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341446 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341618 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341759 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.341925 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342060 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342227 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342377 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342524 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342670 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342815 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.342983 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.343158 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.343291 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.343462 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.343606 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.343749 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.343881 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344056 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344153 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344360 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344510 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344686 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344797 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.344963 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345058 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345263 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345351 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345565 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345652 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345867 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.345954 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.346169 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.346258 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.346473 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.346559 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.346777 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.346868 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.347102 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.347202 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.347406 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.347495 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.347707 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.347803 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.348010 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.348097 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.348308 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.348402 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.348621 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.348727 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.348937 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.349026 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.349243 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.349330 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.349545 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.349706 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.349848 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.349936 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.350165 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:58:26.350252 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.350496 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.350620 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.350826 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.350936 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.351184 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.351283 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.351497 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.351585 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.351827 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.351917 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.352132 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.352219 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.352451 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.352541 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.352763 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.352849 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.353073 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.353160 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.353388 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.353496 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.353695 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.353801 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.354005 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.354097 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.354316 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.354405 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.354629 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.354732 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.355005 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.355138 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.355317 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.355591 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.355692 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.355995 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.356082 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.356309 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.356400 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.356626 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.356720 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.356940 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357036 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357252 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357341 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357566 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357653 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357877 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.357972 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.358186 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.358274 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.358526 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.358613 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.358838 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.358940 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.359187 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.359276 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.359500 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.359595 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.359819 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.359913 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.360130 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.360219 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.360437 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.360524 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.360745 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.360847 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361056 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361143 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361374 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361513 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361680 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361794 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.361997 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.362098 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.362307 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.362413 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.362626 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.362732 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.362953 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363063 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363266 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363364 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363574 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363680 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363882 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.363994 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.364190 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.364289 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.364495 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.364586 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.364804 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.364908 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.365111 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.365228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.365421 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.365519 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.365726 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.365814 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366038 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366131 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366345 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366441 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366650 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366739 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.366983 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367085 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367286 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367383 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367590 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367678 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367893 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.367989 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.368199 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.368286 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.368499 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.368585 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.368808 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.368903 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.369122 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.369210 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.369422 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.369508 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.369745 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.369840 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.370046 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.370133 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.370350 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.370437 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.370697 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.370812 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.371054 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.371271 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.371444 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.371579 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.371767 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.371889 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.372084 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.372199 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.372398 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.372487 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.372711 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.372812 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373026 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373114 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373351 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373440 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373664 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373760 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.373976 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.374063 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.374280 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.374378 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.374588 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.374678 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.374929 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375017 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375231 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375413 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375540 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375636 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375848 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.375937 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.376166 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.376266 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.376474 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.376561 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.376776 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.376862 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.377081 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.377178 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.377386 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.377473 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.377695 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.377782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378003 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378099 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378311 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378401 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378616 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378704 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.378932 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379030 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379239 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379325 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379538 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379633 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379839 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.379929 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.380141 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.380229 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.380444 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.380538 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.380743 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.380830 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381044 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381134 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381345 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381440 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381645 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381733 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.381944 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382032 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382262 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382359 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382565 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382653 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382865 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.382969 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.383204 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.383304 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.383505 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.383593 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.383842 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.383937 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.384143 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.384239 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.384459 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.384558 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.384779 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.384868 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.385090 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.385183 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.385410 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.385509 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.385716 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.385815 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.386031 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.386615 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.386927 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.387074 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.387244 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.387482 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.387579 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.387802 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.387890 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.388118 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.388206 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.388442 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.388538 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.388756 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.388844 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.389078 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.389172 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.389390 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.389491 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.389715 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.389803 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390026 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390113 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390335 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390431 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390640 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390728 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.390978 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.391108 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.391301 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.391404 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.391615 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.391715 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.391935 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392033 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392250 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392355 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392558 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392653 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392873 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.392978 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.393183 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.393281 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.393488 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.393591 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.393795 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.393891 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.394104 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.394201 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.394420 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.394512 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.394729 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.394835 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395065 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395168 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395395 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395501 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395687 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395785 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.395996 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.396084 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.396309 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.396404 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.396611 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.396707 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.396917 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397005 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397230 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397317 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397547 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397644 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397854 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.397941 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.398162 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.398249 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.398469 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.398557 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.398777 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.398863 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.399112 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.399212 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.399417 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.399516 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.399718 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.399804 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400021 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400123 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400330 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400420 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400642 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400729 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.400948 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.401036 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.401255 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.401347 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.401556 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.401651 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.401977 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.402098 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.402302 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.402539 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.402628 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.402859 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.402980 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.403192 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.403282 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.403508 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.403596 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.403835 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.403922 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.404147 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.404245 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.404453 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.404540 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.404773 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.404864 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.405078 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.405168 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.405408 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.405511 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.405697 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.405784 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406003 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406093 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406309 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406405 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406612 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406709 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.406934 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407027 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407345 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407570 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407668 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407882 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.407970 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.408200 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.408287 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.408513 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.408615 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.408828 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.408916 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.409136 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.409223 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.409443 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.409543 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.409751 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.409839 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.410057 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.410145 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.410368 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.410458 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.410687 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.410775 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.411085 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.411348 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.411446 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.411683 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.411771 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.411988 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.412082 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.412307 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.412402 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.412615 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.412705 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.412923 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413022 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413231 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413318 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413534 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413624 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413842 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.413937 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.414157 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.414245 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.414489 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.414714 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.414802 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.415072 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.415164 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.415392 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.415495 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.415713 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.415813 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416018 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416115 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416325 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416436 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416636 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416727 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.416944 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.417033 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.417250 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.417351 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.418118 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.418214 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.418438 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.418759 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.418847 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.419094 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.419192 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.419406 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.419492 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.419713 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.419799 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420041 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420138 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420348 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420447 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420651 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420738 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.420958 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421049 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421264 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421400 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421567 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421664 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421872 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.421967 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.422177 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.422266 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.422745 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.422842 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.423075 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.423179 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.423387 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.423483 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.423691 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.423787 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424015 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424104 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424326 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424414 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424631 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424728 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.424938 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425043 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425249 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425339 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425558 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425719 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425866 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.425955 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.426179 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.426268 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.426497 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.426637 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.426799 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.426889 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.427139 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.427244 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.427447 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.427538 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.427761 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.427850 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428063 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428157 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428370 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428459 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428673 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428762 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.428980 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.429075 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.429287 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.429377 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.429589 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.429675 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.429897 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430064 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430202 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430297 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430511 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430814 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.430929 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.431136 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.431235 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.431445 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.431543 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.431747 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.431845 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432052 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432139 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432358 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432446 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432662 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432752 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.432964 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.433136 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.433349 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.433489 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.433664 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.433990 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.434079 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.434306 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.434407 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.434625 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.434728 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.434951 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435044 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435282 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435382 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435591 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435689 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435899 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.435997 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.436205 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.436292 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.436517 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.436620 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.436824 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.436911 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.437126 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.437212 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.437433 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.437523 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.437740 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.437828 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438040 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438126 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438345 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438434 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438648 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438734 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.438970 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.439059 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.439276 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.439367 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.439581 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.439667 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.439900 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440000 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440211 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440307 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440512 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440599 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440814 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.440910 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.441112 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.441207 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.441414 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.441501 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.441717 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.441827 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442022 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442110 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442323 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442410 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442624 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442720 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.442948 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.443101 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.443313 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.443625 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.444429 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.444429 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.444927 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445006 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445109 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445199 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445416 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445514 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445723 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.445810 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.446033 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.446130 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.446375 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.446473 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.446682 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.446778 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447045 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447134 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447363 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447454 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447676 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447764 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.447992 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.448087 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.448304 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.448393 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.449142 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.449307 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.449482 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.449725 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.449818 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.450207 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.450296 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.450530 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.450618 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.450844 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.450955 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.451184 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.451274 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.451492 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.451580 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.451797 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.451894 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.452105 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.452200 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.452416 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.452503 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.452726 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.452813 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453032 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453120 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453343 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453440 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453654 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453749 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.453956 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.454042 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.454266 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.454372 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.454577 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.454667 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.454882 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455053 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455217 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455356 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455518 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455610 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455826 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.455935 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.456133 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.456244 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.456444 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.456559 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.456753 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.456872 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457062 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457182 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457366 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457488 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457674 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457798 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.457984 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.458110 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.458287 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.458427 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.458609 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.458744 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.458938 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.459076 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.459246 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.459501 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.459589 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.459815 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.459906 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.460126 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.460214 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.460427 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.460513 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.460731 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.460849 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461036 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461158 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461344 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461477 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461671 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461769 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.461977 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.462118 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.462275 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.462411 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.462554 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.462697 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.462884 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.463003 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.463209 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.463298 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.463532 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.463661 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.463950 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.464038 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.464337 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.464935 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.465299 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.465406 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.465727 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.465826 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.466043 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.466143 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.466358 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.466449 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.466685 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.466771 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467024 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467128 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467332 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467421 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467637 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467724 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.467957 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468045 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468259 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468354 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468580 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468679 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468904 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.468991 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.469216 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.469318 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.469538 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.469627 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.469846 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.469977 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.470171 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.470290 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.470495 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.470583 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.470810 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.470950 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.471161 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.471252 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.471556 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.471653 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.471861 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.471951 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.472175 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.472266 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.472486 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.472575 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.472811 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.472915 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.473120 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.473222 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.473426 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.473515 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.473736 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.473835 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474041 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474129 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474346 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474434 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474670 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474767 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.474998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.475090 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.475312 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.475450 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.475625 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.475725 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.475936 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476025 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476244 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476381 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476549 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476646 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476871 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.476961 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.477176 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.477272 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.477500 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.477597 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.477813 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.477902 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.478112 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.478201 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.478414 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.478504 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.478736 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.478826 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.479066 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.479165 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.479375 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.479465 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.479683 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.479772 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.480013 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.480138 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.480319 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.480590 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.480679 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.480933 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481020 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481259 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481349 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481565 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481660 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481889 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.481977 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.482202 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.482300 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.482524 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.482612 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.482843 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.482970 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.483174 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.483272 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.483495 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.483590 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.483806 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.483902 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.484110 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.484197 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.484413 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.484499 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.484715 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.484816 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485027 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485125 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485331 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485419 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485635 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485741 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.485938 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486027 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486245 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486333 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486550 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486652 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486851 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.486972 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.487180 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.487277 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.487505 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.487596 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.487811 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.487900 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.488136 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.488231 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.488445 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.488534 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.488748 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.488837 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489051 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489138 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489356 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489451 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489658 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489747 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.489960 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.490048 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.490264 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.490354 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.490570 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.490658 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.490872 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491000 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491199 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491289 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491499 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491596 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491819 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.491916 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.492123 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.492212 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.492443 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.492533 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.492751 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.492848 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493054 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493151 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493355 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493444 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493655 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493753 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.493970 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.494059 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.494289 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.494376 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.494617 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.494807 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.494947 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.495163 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.495275 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.495496 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.495714 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.495884 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.496217 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.496312 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.496622 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.496723 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.496940 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497030 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497346 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497571 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497667 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497885 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.497983 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.498197 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.498291 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.498515 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.498612 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.498833 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.498953 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.499179 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.499275 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.499517 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.499696 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.499835 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500024 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500152 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500340 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500468 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500654 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500784 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.500969 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.501142 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.501283 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.501453 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.501597 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.501753 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.501912 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.502068 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.502224 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.502369 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.502536 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.502689 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.502845 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503029 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503196 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503344 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503514 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503661 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503840 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.503975 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.504175 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.504287 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.504491 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.504601 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.504805 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.504905 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.505119 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.505209 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.505434 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.505522 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.505786 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.505885 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.506097 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.506186 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.506407 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.506496 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.506722 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.506833 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.507092 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.507183 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.507466 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.507610 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.507778 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.507930 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.508089 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.508264 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.508400 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.508593 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.508712 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.508921 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509010 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509237 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509561 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509659 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509888 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.509978 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.510200 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.510289 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.510509 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.510606 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.510821 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.510991 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.511707 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.511845 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.512133 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.512236 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.512607 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.512718 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.512791 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.513078 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.513185 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.513400 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.513490 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.513714 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.513804 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.514136 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.514237 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.514465 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.514577 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.514782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.514926 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.515124 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.515253 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.515453 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.515582 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.515765 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.515930 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.516083 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.516221 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.516365 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.516515 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.516658 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.516866 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517014 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517153 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517286 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517423 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517560 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517696 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.517867 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.518014 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.518184 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.518334 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.518479 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.518615 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.518883 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.519031 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.519213 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.519374 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.519531 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.519691 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.519835 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.520016 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.520162 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.520342 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.520535 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.520686 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.520909 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.521170 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.521266 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.521561 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.521659 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.521875 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.522086 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.522193 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.522511 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.522609 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.522820 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.523114 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.523225 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.523461 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.523639 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.523776 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.524085 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.524175 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.524398 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.524707 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.524796 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.525054 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.525260 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.525350 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.525677 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.525772 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.526050 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.526152 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.526358 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.526447 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.526667 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.527370 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.527601 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.527762 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.527908 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.528161 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.528262 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.528472 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.528570 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.528821 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.528909 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.529138 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.529234 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.529449 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.529683 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.529781 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.530027 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.530132 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.530348 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.530435 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.530663 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.530761 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.531017 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.531131 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.531449 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.531537 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.531762 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.532044 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.532146 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.532390 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.532607 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.532697 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.533010 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.533234 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.533331 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.533624 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.533806 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.533937 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.534252 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.534343 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.534565 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.534877 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.535010 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.535213 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.535513 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.535603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.535824 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.536087 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.536175 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.536435 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.536626 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.536747 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.537064 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.537175 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.537408 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.537579 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.537728 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.537818 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.538047 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.538139 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.538368 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.538466 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.538688 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.538798 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.539025 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.539344 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.539431 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.539657 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.539749 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.539969 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.540060 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.540285 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.540389 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.540622 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.540720 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.540940 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.541029 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.541247 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.541345 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.541579 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.541951 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.542053 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.542272 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.542404 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.543160 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.543253 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.543487 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.543793 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.543882 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.544118 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.544207 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.544434 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.544522 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.544746 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.544834 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.545060 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.545149 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.545375 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.545462 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.545691 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.545778 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546005 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546095 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546320 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546411 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546632 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546735 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.546970 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.547063 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.547533 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.547629 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.547848 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.547945 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.548162 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.548256 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.548481 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.548569 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.548793 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.548891 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.549101 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.549197 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.549413 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.549501 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.549722 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.549822 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550028 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550117 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550335 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550423 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550641 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550740 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.550966 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551070 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551280 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551370 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551586 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551683 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551889 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.551977 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.552195 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.552501 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.552615 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.552803 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.552899 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.553108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.553204 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.553418 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.553508 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.553721 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.553809 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554023 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554112 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554326 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554417 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554629 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554717 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.554952 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.555046 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.555288 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.555380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.555623 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.555719 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.555940 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556028 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556265 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556356 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556576 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556673 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556882 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.556979 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.557188 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.557277 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.557494 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.557590 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.557805 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.557910 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.558670 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.558783 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.559011 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.559329 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.559431 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.559642 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.559741 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.559953 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560041 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560264 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560361 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560568 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560657 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560875 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.560964 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.561181 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.561279 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.561502 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.561593 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.561795 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.561883 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.562100 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.562201 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.562464 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.562568 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.562709 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.562799 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563041 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563153 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563347 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563439 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563652 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563741 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.563961 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564051 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564265 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564353 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564568 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564656 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564870 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.564959 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.565172 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.565260 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.565478 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.565565 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.565795 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.565886 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.566106 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.566195 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.566418 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.566519 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.566740 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.566830 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.567073 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.567172 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.567394 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.567495 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.567703 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.567792 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568020 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568106 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568335 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568431 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568648 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568735 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.568959 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569056 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569290 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569388 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569600 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569698 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569910 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.569999 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.570219 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.570308 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.570528 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.570625 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.570838 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.571019 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.571118 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:58:26.571200 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.571481 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.571805 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.572110 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.572433 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.572746 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.573063 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.573378 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.573829 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.574406 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.574727 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.575062 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.575382 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.575693 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.576005 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.576320 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.576633 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.576943 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.577259 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.577575 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.577903 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.578229 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.578540 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.578866 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.579216 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.579563 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.579876 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.580219 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.580549 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.580863 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.581174 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.581477 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:58:26.581718 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:58:26.724383 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO dbcounter [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Registered counter for database nova_api Sep 13 15:58:26.737880 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO dbcounter [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Registered counter for database nova_api Sep 13 15:58:26.746339 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_db.sqlalchemy.engines [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:26.753042 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writer thread running {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:26.758256 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:26.765628 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writer thread running {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:26.812135 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.context [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3524178c-5c28-4931-8ce8-d0486ae70a8d(cell1) {{(pid=105647) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 15:58:26.816229 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_concurrency.lockutils [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:58:26.816650 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_concurrency.lockutils [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:58:26.818232 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_concurrency.lockutils [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:58:26.818994 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_concurrency.lockutils [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:58:26.819450 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_concurrency.lockutils [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:58:26.821424 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_concurrency.lockutils [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:58:26.823453 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO dbcounter [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Registered counter for database nova_cell0 Sep 13 15:58:26.823671 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.context [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3524178c-5c28-4931-8ce8-d0486ae70a8d(cell1) {{(pid=105648) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 15:58:26.827532 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO dbcounter [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Registered counter for database nova_cell1 Sep 13 15:58:26.827908 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:58:26.828378 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:58:26.829934 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:58:26.830661 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:58:26.831136 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:58:26.833114 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:58:26.834893 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_db.sqlalchemy.engines [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:26.835293 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO dbcounter [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Registered counter for database nova_cell0 Sep 13 15:58:26.836655 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_db.sqlalchemy.engines [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:26.839189 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO dbcounter [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Registered counter for database nova_cell1 Sep 13 15:58:26.843204 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writer thread running {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:26.845468 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writer thread running {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:26.846861 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:26.850259 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:26.852250 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writer thread running {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:26.994232 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO dbcounter [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Registered counter for database nova_cell0 Sep 13 15:58:27.001372 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG oslo_db.sqlalchemy.engines [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:27.004530 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writer thread running {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:27.006023 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writer thread running {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:27.013401 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO dbcounter [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Registered counter for database nova_cell0 Sep 13 15:58:27.021979 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:58:27.027272 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writer thread running {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:58:27.348144 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: WARNING keystonemiddleware.auth_token [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:58:27.348689 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: WARNING keystonemiddleware.auth_token [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:58:27.356317 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: WARNING keystonemiddleware.auth_token [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:58:27.356699 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: WARNING keystonemiddleware.auth_token [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:58:27.701572 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: WARNING keystonemiddleware.auth_token [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:58:27.704213 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: WARNING keystonemiddleware.auth_token [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:58:27.707496 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: WARNING keystonemiddleware.auth_token [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:58:27.710080 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: WARNING keystonemiddleware.auth_token [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:58:27.712878 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55579de0e9c0 pid: 105647 (default app) Sep 13 15:58:27.715564 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:58:27.716193 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55579de0e9c0 pid: 105648 (default app) Sep 13 15:58:27.716807 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-da77810d-9314-47fd-98d9-cc053a98446d None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002345 Sep 13 15:58:27.717229 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Tue Sep 13 15:58:27 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:59:48.815796 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:59:48.817043 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Sep 13 15:59:48.817452 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 15:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:59:48.829076 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_api:SELECT=3 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:48.830387 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_cell0:SELECT=3 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:48.831203 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_cell1:SELECT=3 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:48.843320 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:49.733803 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-1af6dcd4-f0ac-4da2-9aba-4f5ba8a7b6a9 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:59:49.767516 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-1af6dcd4-f0ac-4da2-9aba-4f5ba8a7b6a9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.944004 Sep 13 15:59:49.768474 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 2/3] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Sep 13 15:59:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:59:52.403945 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:59:52.404941 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-a9b16702-fdf6-47f4-8b01-462160d28667 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 13 15:59:52.405507 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 2/4] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 15:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:59:52.848060 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-df24b088-0827-4d20-a8fb-6a07edb2dc58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:59:52.895404 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-df24b088-0827-4d20-a8fb-6a07edb2dc58 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482356 Sep 13 15:59:52.896162 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 3/5] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 15:59:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:59:52.910630 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_api:SELECT=3 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:52.911587 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_cell0:SELECT=3 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:52.912324 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_cell1:SELECT=3 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:52.913050 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_cell0:SELECT=3 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:59:53.119925 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-4c9aefa1-0553-4888-a06f-280b88b80156 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:59:53.190267 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-4c9aefa1-0553-4888-a06f-280b88b80156 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285803 Sep 13 15:59:53.190842 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 3/6] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Sep 13 15:59:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:59:55.845982 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-df24b088-0827-4d20-a8fb-6a07edb2dc58 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:59:55.847687 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-df24b088-0827-4d20-a8fb-6a07edb2dc58 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Sep 13 15:59:55.848254 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 4/7] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 15:59:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:59:56.523352 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-9ba50a38-266f-41c8-ad45-94920b946edc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:59:56.566636 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-9ba50a38-266f-41c8-ad45-94920b946edc admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.711640 Sep 13 15:59:56.567921 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 4/8] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 15:59:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:59:56.579734 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-ea91b4cd-fc27-4e93-8613-5d9df583f1e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:59:56.623626 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-ea91b4cd-fc27-4e93-8613-5d9df583f1e2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047711 Sep 13 15:59:56.631192 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 5/9] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Sep 13 15:59:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:59:59.255847 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-9ba50a38-266f-41c8-ad45-94920b946edc admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:59:59.256859 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-9ba50a38-266f-41c8-ad45-94920b946edc admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 13 15:59:59.257284 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 15:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:59:59.680199 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-031017bc-f028-44da-8132-31d9bfd15bbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:59:59.699320 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-031017bc-f028-44da-8132-31d9bfd15bbd admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435432 Sep 13 15:59:59.699856 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 6/11] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 15:59:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:59:59.712566 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-8d2932f3-e127-47af-a999-243f6ee6bada admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:59:59.742581 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-8d2932f3-e127-47af-a999-243f6ee6bada admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033810 Sep 13 15:59:59.743273 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 6/12] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Sep 13 15:59:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:00:02.385902 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-031017bc-f028-44da-8132-31d9bfd15bbd admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:02.386956 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-031017bc-f028-44da-8132-31d9bfd15bbd admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 13 16:00:02.387363 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 7/13] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:02.823315 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-0fedeaa9-688c-4eb2-ac1f-a060d9397bf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:02.842247 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-0fedeaa9-688c-4eb2-ac1f-a060d9397bf5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448799 Sep 13 16:00:02.843164 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 7/14] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:00:02.855673 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-01653516-a32a-432d-826d-803f0e5c516a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:02.883861 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-01653516-a32a-432d-826d-803f0e5c516a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031700 Sep 13 16:00:02.884502 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 8/15] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Sep 13 16:00:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:00:05.524139 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-0fedeaa9-688c-4eb2-ac1f-a060d9397bf5 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:05.525073 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-0fedeaa9-688c-4eb2-ac1f-a060d9397bf5 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 13 16:00:05.525482 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 8/16] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:00:05.933909 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2fafba7e-ae33-493f-a924-50c4e8298074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "ram": 4096, "id": "d4", "name": "ds4G"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:05.953085 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-2fafba7e-ae33-493f-a924-50c4e8298074 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421330 Sep 13 16:00:05.953649 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 9/17] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:00:05.967614 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-bf1b6213-054b-45ed-b395-b994dc0a11fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:06.000300 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-bf1b6213-054b-45ed-b395-b994dc0a11fd admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037339 Sep 13 16:00:06.001024 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 9/18] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Sep 13 16:00:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:00:08.668039 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2fafba7e-ae33-493f-a924-50c4e8298074 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:08.669059 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-2fafba7e-ae33-493f-a924-50c4e8298074 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 13 16:00:08.669462 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 10/19] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:09.212817 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-910b8e2e-046c-4f85-8a05-2d82e1705da2 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:09.238396 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-910b8e2e-046c-4f85-8a05-2d82e1705da2 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.562116 Sep 13 16:00:09.238967 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 10/20] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Sep 13 16:00:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:11.987669 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2fafba7e-ae33-493f-a924-50c4e8298074 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:11.988734 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-2fafba7e-ae33-493f-a924-50c4e8298074 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 13 16:00:11.989311 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 11/21] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:12.399418 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-8fbe0194-deba-4874-ae04-397f6b854c91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:12.418845 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-8fbe0194-deba-4874-ae04-397f6b854c91 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420097 Sep 13 16:00:12.419407 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 11/22] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:00:12.432027 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-981883a7-3314-462f-9097-2c0c63d348fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:12.459089 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-981883a7-3314-462f-9097-2c0c63d348fe admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030639 Sep 13 16:00:12.459664 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 12/23] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Sep 13 16:00:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:00:15.077501 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-8fbe0194-deba-4874-ae04-397f6b854c91 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:15.078512 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-8fbe0194-deba-4874-ae04-397f6b854c91 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 13 16:00:15.079103 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:15.478402 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-974d992c-ab26-4dfd-85c4-5e98d07fa261 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "ram": 2048}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:15.497428 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-974d992c-ab26-4dfd-85c4-5e98d07fa261 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411556 Sep 13 16:00:15.497984 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 13/25] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:00:15.510703 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-baa5c1a1-aca3-4120-af2a-37bcc8b4827a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:15.536136 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-baa5c1a1-aca3-4120-af2a-37bcc8b4827a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029011 Sep 13 16:00:15.536702 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 13/26] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Sep 13 16:00:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:00:18.178642 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-974d992c-ab26-4dfd-85c4-5e98d07fa261 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:18.179685 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-974d992c-ab26-4dfd-85c4-5e98d07fa261 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 13 16:00:18.180076 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 14/27] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:18.653717 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-5eea507a-895e-45cc-8459-83747ae9ab9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:18.678782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-5eea507a-895e-45cc-8459-83747ae9ab9c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.492639 Sep 13 16:00:18.679759 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 14/28] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:00:18.691738 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-c6aa4d6f-f443-488c-b958-91636fbd1ddf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:18.720602 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-c6aa4d6f-f443-488c-b958-91636fbd1ddf admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032225 Sep 13 16:00:18.721177 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 15/29] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Sep 13 16:00:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:00:21.483189 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-5eea507a-895e-45cc-8459-83747ae9ab9c admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:21.484845 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-5eea507a-895e-45cc-8459-83747ae9ab9c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Sep 13 16:00:21.487858 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 15/30] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:22.008565 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-d75b9126-e791-468e-99ac-0bcc74110f34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "4"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:22.014386 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:00:22.030773 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-d75b9126-e791-468e-99ac-0bcc74110f34 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.538634 Sep 13 16:00:22.031452 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 16/31] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:00:22.044721 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-c2871c08-d3ea-496c-b3fd-92dfaa70bd79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:22.071528 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-c2871c08-d3ea-496c-b3fd-92dfaa70bd79 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030439 Sep 13 16:00:22.072294 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 16/32] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Sep 13 16:00:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:00:24.709264 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-d75b9126-e791-468e-99ac-0bcc74110f34 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:24.710318 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-d75b9126-e791-468e-99ac-0bcc74110f34 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 13 16:00:24.710724 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 17/33] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:25.169366 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-f231f2cb-2626-4640-98ac-6004f4af70a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5"}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:25.177367 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:00:25.195950 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-f231f2cb-2626-4640-98ac-6004f4af70a1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.479066 Sep 13 16:00:25.196882 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 17/34] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Sep 13 16:00:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:00:25.209469 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-483f4e96-5ab5-4c7b-a997-613414195a60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:25.236873 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-483f4e96-5ab5-4c7b-a997-613414195a60 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031123 Sep 13 16:00:25.237379 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 18/35] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Sep 13 16:00:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:00:43.323901 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-f231f2cb-2626-4640-98ac-6004f4af70a1 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:43.324911 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-f231f2cb-2626-4640-98ac-6004f4af70a1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 13 16:00:43.325327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 18/36] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:43.336561 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:00:43.718355 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-3a4813c8-f13a-4c6d-b914-1f48ffa664c5 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:43.736843 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-3a4813c8-f13a-4c6d-b914-1f48ffa664c5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404643 Sep 13 16:00:43.737457 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 19/37] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Sep 13 16:00:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:45.050308 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-f231f2cb-2626-4640-98ac-6004f4af70a1 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:45.051334 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-f231f2cb-2626-4640-98ac-6004f4af70a1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 13 16:00:45.051737 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 19/38] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:45.575048 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-8274fd76-b25f-4b7b-bfcb-6a7f4d9aff79 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:45.581032 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.wsgi [None req-8274fd76-b25f-4b7b-bfcb-6a7f4d9aff79 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-8274fd76-b25f-4b7b-bfcb-6a7f4d9aff79 admin admin] Request method failure captured: Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Accept: application/json Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Accept-Encoding: gzip, deflate Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Connection: keep-alive Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Content-Length: 0 Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Host: 10.222.0.50 Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Openstack-Api-Version: compute 2.92 Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Openstack-System-Scope: None Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: User-Agent: python-novaclient Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Auth-Token: gAAAAABjIKksX00dR8UkyjHo2srLGrHv-FOnm05x23piT1DOoXkKluRYx2hQKqWUMoFk0KD0-CxBLQxn7F6fTSpHJEjP479ja3Xnhspb-OdxA_gE7pOOMvImuYRKocp2JrnMamjb6P8W8-rc_B0Ic7FF7F9_Wi2a6CZnlAhDaw95cQ9-gnzLcP0 Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Domain-Id: None Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Domain-Name: None Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Identity-Status: Confirmed Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Is-Admin-Project: True Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Domain-Id: default Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Domain-Name: Default Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Name: admin Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Role: admin,member,reader Sep 13 16:00:45.584316 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Roles: admin,member,reader Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_555bee08a3fa4d08bdd8ecc881adc45b"}]}] Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant: admin Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant-Name: admin Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User: admin Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Domain-Id: default Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Domain-Name: Default Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Id: e0a915a0eb3c42c7af97dcc7eed5b42f Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Name: admin Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: method: > Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: exception: Flavor 42 could not be found. Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: action_args: {'id': '42'} Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:00:45.585998 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:45.587072 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.588233 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-8274fd76-b25f-4b7b-bfcb-6a7f4d9aff79 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:00:45.589285 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-8274fd76-b25f-4b7b-bfcb-6a7f4d9aff79 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.395636 Sep 13 16:00:45.589285 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 20/39] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Sep 13 16:00:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:00:45.596162 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-03c8e853-bb00-442b-8b9b-b729b4537cd3 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:45.619728 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-03c8e853-bb00-442b-8b9b-b729b4537cd3 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027811 Sep 13 16:00:45.620258 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 20/40] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Sep 13 16:00:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:00:45.631159 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-573e4f98-7cb6-4da0-9b50-50c67f9baf4d admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:45.653261 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-573e4f98-7cb6-4da0-9b50-50c67f9baf4d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026540 Sep 13 16:00:45.653787 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 21/41] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Sep 13 16:00:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:45.664172 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-25b99794-e4bb-4cc9-89da-50401ae2e462 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:45.669402 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.wsgi [None req-25b99794-e4bb-4cc9-89da-50401ae2e462 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-25b99794-e4bb-4cc9-89da-50401ae2e462 admin admin] Request method failure captured: Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Accept: application/json Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Accept-Encoding: gzip, deflate Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Connection: keep-alive Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Content-Length: 0 Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Host: 10.222.0.50 Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Openstack-Api-Version: compute 2.92 Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Openstack-System-Scope: None Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: User-Agent: python-novaclient Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Auth-Token: gAAAAABjIKksX00dR8UkyjHo2srLGrHv-FOnm05x23piT1DOoXkKluRYx2hQKqWUMoFk0KD0-CxBLQxn7F6fTSpHJEjP479ja3Xnhspb-OdxA_gE7pOOMvImuYRKocp2JrnMamjb6P8W8-rc_B0Ic7FF7F9_Wi2a6CZnlAhDaw95cQ9-gnzLcP0 Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Domain-Id: None Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Domain-Name: None Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Identity-Status: Confirmed Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Is-Admin-Project: True Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Domain-Id: default Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Domain-Name: Default Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Name: admin Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Role: admin,member,reader Sep 13 16:00:45.672791 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Roles: admin,member,reader Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_555bee08a3fa4d08bdd8ecc881adc45b"}]}] Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant: admin Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant-Name: admin Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User: admin Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Domain-Id: default Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Domain-Name: Default Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Id: e0a915a0eb3c42c7af97dcc7eed5b42f Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Name: admin Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: method: > Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: exception: Flavor 42 could not be found. Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: action_args: {'id': '42'} Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:00:45.674314 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:45.675233 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:45.676274 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-25b99794-e4bb-4cc9-89da-50401ae2e462 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:00:45.677319 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-25b99794-e4bb-4cc9-89da-50401ae2e462 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013819 Sep 13 16:00:45.677319 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 21/42] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Sep 13 16:00:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 16:00:46.901009 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-573e4f98-7cb6-4da0-9b50-50c67f9baf4d admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:46.902040 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-573e4f98-7cb6-4da0-9b50-50c67f9baf4d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 13 16:00:46.902434 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 22/43] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:47.426162 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-efad92cd-65bf-4be1-a20d-d2e28ebc2e6b admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:47.431180 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.wsgi [None req-efad92cd-65bf-4be1-a20d-d2e28ebc2e6b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-efad92cd-65bf-4be1-a20d-d2e28ebc2e6b admin admin] Request method failure captured: Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Accept: application/json Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Accept-Encoding: gzip, deflate Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Connection: keep-alive Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Content-Length: 0 Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Host: 10.222.0.50 Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Openstack-Api-Version: compute 2.92 Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Openstack-System-Scope: None Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: User-Agent: python-novaclient Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Auth-Token: gAAAAABjIKkuqYF-yx6OefZSad6_FVRpYO0R2NaciYiTtysBYizWlNsNEp0CzolMLMhjUycf3Pn9P3gQD-D7BjtW4ZEKrLGnTJFVhpLM4x2wHcKse7Tu7lJ2qMx-44mhTBkCK0t9imkWgKvY4jlJmR8ypyQTJqPP7sjMtZYlwnkpotjktohEdhE Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Domain-Id: None Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Domain-Name: None Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Identity-Status: Confirmed Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Is-Admin-Project: True Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Domain-Id: default Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Domain-Name: Default Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Name: admin Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Role: admin,member,reader Sep 13 16:00:47.432694 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Roles: admin,member,reader Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_555bee08a3fa4d08bdd8ecc881adc45b"}]}] Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant: admin Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant-Name: admin Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User: admin Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Domain-Id: default Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Domain-Name: Default Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Id: e0a915a0eb3c42c7af97dcc7eed5b42f Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Name: admin Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: method: > Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: exception: Flavor 84 could not be found. Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: action_args: {'id': '84'} Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:00:47.434228 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:47.435239 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.437460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-efad92cd-65bf-4be1-a20d-d2e28ebc2e6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:00:47.438785 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-efad92cd-65bf-4be1-a20d-d2e28ebc2e6b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390641 Sep 13 16:00:47.438785 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Sep 13 16:00:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:00:47.444485 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-d554f9cd-6d62-4c1d-8492-eaf58b634c59 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:47.459884 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-d554f9cd-6d62-4c1d-8492-eaf58b634c59 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018957 Sep 13 16:00:47.460429 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Sep 13 16:00:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:47.469955 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-9986b5c8-7713-4701-bd64-c179aa57c28f admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:47.485075 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-9986b5c8-7713-4701-bd64-c179aa57c28f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018986 Sep 13 16:00:47.485594 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Sep 13 16:00:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:47.494558 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2e854dc6-b779-409b-b934-51091d5f12b1 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:47.499932 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.wsgi [None req-2e854dc6-b779-409b-b934-51091d5f12b1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2e854dc6-b779-409b-b934-51091d5f12b1 admin admin] Request method failure captured: Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Accept: application/json Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Accept-Encoding: gzip, deflate Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Connection: keep-alive Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Content-Length: 0 Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Host: 10.222.0.50 Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Openstack-Api-Version: compute 2.92 Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Openstack-System-Scope: None Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: User-Agent: python-novaclient Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Auth-Token: gAAAAABjIKkuqYF-yx6OefZSad6_FVRpYO0R2NaciYiTtysBYizWlNsNEp0CzolMLMhjUycf3Pn9P3gQD-D7BjtW4ZEKrLGnTJFVhpLM4x2wHcKse7Tu7lJ2qMx-44mhTBkCK0t9imkWgKvY4jlJmR8ypyQTJqPP7sjMtZYlwnkpotjktohEdhE Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Domain-Id: None Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Domain-Name: None Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Identity-Status: Confirmed Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Is-Admin-Project: True Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Domain-Id: default Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Domain-Name: Default Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Name: admin Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Role: admin,member,reader Sep 13 16:00:47.501401 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Roles: admin,member,reader Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_555bee08a3fa4d08bdd8ecc881adc45b"}]}] Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant: admin Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant-Name: admin Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User: admin Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Domain-Id: default Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Domain-Name: Default Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Id: e0a915a0eb3c42c7af97dcc7eed5b42f Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Name: admin Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: method: > Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: exception: Flavor 84 could not be found. Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: action_args: {'id': '84'} Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:00:47.503108 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:47.504257 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:47.505603 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2e854dc6-b779-409b-b934-51091d5f12b1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:00:47.506844 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-2e854dc6-b779-409b-b934-51091d5f12b1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011596 Sep 13 16:00:47.506844 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 24/47] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Sep 13 16:00:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:00:48.729838 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-9986b5c8-7713-4701-bd64-c179aa57c28f admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:48.730834 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-9986b5c8-7713-4701-bd64-c179aa57c28f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 13 16:00:48.731247 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 24/48] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:00:49.256662 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-e0bd5ceb-6fa1-4e80-bcc5-b03424ca1b2a admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:49.262368 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.wsgi [None req-e0bd5ceb-6fa1-4e80-bcc5-b03424ca1b2a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-e0bd5ceb-6fa1-4e80-bcc5-b03424ca1b2a admin admin] Request method failure captured: Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Accept: application/json Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Accept-Encoding: gzip, deflate Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Connection: keep-alive Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Content-Length: 0 Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Host: 10.222.0.50 Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Openstack-Api-Version: compute 2.92 Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Openstack-System-Scope: None Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: User-Agent: python-novaclient Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Auth-Token: gAAAAABjIKkw_HLrtxCaPwwG6A_IOaE3pfbhGPN06uNB-pkStue1MkIU1ejjN3mDp1kcsTFDFD1zShIJXwRYu4yq4lvvafW4F2rXyPiTh0ggYEP1uZ7p4KgkZuz9IEvB1mC_0hXIgIMsK38E3o9P6zltJgFAmhynnYUQmbz8hjP-17JIOarff1o Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Domain-Id: None Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Domain-Name: None Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Identity-Status: Confirmed Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Is-Admin-Project: True Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Domain-Id: default Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Domain-Name: Default Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Project-Name: admin Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Role: admin,member,reader Sep 13 16:00:49.264548 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Roles: admin,member,reader Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_555bee08a3fa4d08bdd8ecc881adc45b"}]}] Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant: admin Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-Tenant-Name: admin Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User: admin Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Domain-Id: default Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Domain-Name: Default Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Id: e0a915a0eb3c42c7af97dcc7eed5b42f Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: X-User-Name: admin Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: method: > Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: exception: Flavor 451 could not be found. Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: action_args: {'id': '451'} Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:00:49.266004 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:49.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.268415 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-e0bd5ceb-6fa1-4e80-bcc5-b03424ca1b2a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:00:49.269697 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-e0bd5ceb-6fa1-4e80-bcc5-b03424ca1b2a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392032 Sep 13 16:00:49.269697 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 25/49] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Sep 13 16:00:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:00:49.275643 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-fc35cc16-c306-45e3-b63a-11a771d15e91 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:49.291532 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-fc35cc16-c306-45e3-b63a-11a771d15e91 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019464 Sep 13 16:00:49.292052 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 25/50] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Sep 13 16:00:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:49.301454 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:49.316061 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018151 Sep 13 16:00:49.316580 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 26/51] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Sep 13 16:00:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:00:49.325700 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-1b3c2b24-6224-4048-b0ba-8d83b70c7bbc admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:49.331285 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.wsgi [None req-1b3c2b24-6224-4048-b0ba-8d83b70c7bbc admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-1b3c2b24-6224-4048-b0ba-8d83b70c7bbc admin admin] Request method failure captured: Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Accept: application/json Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Accept-Encoding: gzip, deflate Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Connection: keep-alive Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Content-Length: 0 Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Host: 10.222.0.50 Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Openstack-Api-Version: compute 2.92 Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Openstack-System-Scope: None Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: User-Agent: python-novaclient Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Auth-Token: gAAAAABjIKkw_HLrtxCaPwwG6A_IOaE3pfbhGPN06uNB-pkStue1MkIU1ejjN3mDp1kcsTFDFD1zShIJXwRYu4yq4lvvafW4F2rXyPiTh0ggYEP1uZ7p4KgkZuz9IEvB1mC_0hXIgIMsK38E3o9P6zltJgFAmhynnYUQmbz8hjP-17JIOarff1o Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Domain-Id: None Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Domain-Name: None Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Identity-Status: Confirmed Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Is-Admin-Project: True Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Domain-Id: default Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Domain-Name: Default Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Project-Name: admin Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Role: admin,member,reader Sep 13 16:00:49.332782 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Roles: admin,member,reader Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/555bee08a3fa4d08bdd8ecc881adc45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_555bee08a3fa4d08bdd8ecc881adc45b"}]}] Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant: admin Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant-Id: 555bee08a3fa4d08bdd8ecc881adc45b Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-Tenant-Name: admin Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User: admin Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Domain-Id: default Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Domain-Name: Default Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Id: e0a915a0eb3c42c7af97dcc7eed5b42f Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: X-User-Name: admin Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: method: > Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: exception: Flavor 451 could not be found. Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: action_args: {'id': '451'} Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:00:49.334327 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:49.335321 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: ERROR nova.api.openstack.wsgi Sep 13 16:00:49.336380 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-1b3c2b24-6224-4048-b0ba-8d83b70c7bbc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:00:49.337432 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-1b3c2b24-6224-4048-b0ba-8d83b70c7bbc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011888 Sep 13 16:00:49.337432 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 26/52] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Sep 13 16:00:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:00:50.565996 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:50.567055 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 13 16:00:50.567448 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 27/53] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:51.095259 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-0dcdbc48-6124-475e-8051-de5a97957294 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:51.114543 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-0dcdbc48-6124-475e-8051-de5a97957294 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.409364 Sep 13 16:00:51.115111 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 27/54] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Sep 13 16:00:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:00:52.333103 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:52.334107 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 13 16:00:52.334501 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:52.863153 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-a1917934-7d2b-47d7-823a-6f7a89256018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:52.882390 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-a1917934-7d2b-47d7-823a-6f7a89256018 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408032 Sep 13 16:00:52.882869 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 28/56] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Sep 13 16:00:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:00:54.096374 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:54.097372 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 13 16:00:54.097763 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 29/57] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:54.630411 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-349319a2-4af1-4627-80a2-4d2620869dd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:54.649966 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-349319a2-4af1-4627-80a2-4d2620869dd6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.416576 Sep 13 16:00:54.650570 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 29/58] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Sep 13 16:00:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:00:55.871704 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:55.873427 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Sep 13 16:00:55.873843 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 30/59] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:56.395460 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-53333057-6c67-4f42-b1c5-cbe836f169eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:00:56.415659 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-53333057-6c67-4f42-b1c5-cbe836f169eb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404460 Sep 13 16:00:56.416206 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 30/60] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Sep 13 16:00:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:00:57.636744 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:57.637854 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 13 16:00:57.638270 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 31/61] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:00:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:00:58.165854 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-3622c04e-5c00-4a64-9150-3135e90fe82f admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:00:58.187378 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-3622c04e-5c00-4a64-9150-3135e90fe82f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.411263 Sep 13 16:00:58.187916 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 31/62] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Sep 13 16:00:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:01:55.228432 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:01:55.229437 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-a37f64c6-00f8-40ad-9d1f-7ec3c32cad55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 13 16:01:55.229830 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 32/63] 10.222.0.50 () {54 vars in 931 bytes} [Tue Sep 13 16:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:01:55.240281 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:01:55.616306 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-6e4ddc11-da9b-4e7e-bbed-57e27dcd12c3 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:01:55.637557 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-6e4ddc11-da9b-4e7e-bbed-57e27dcd12c3 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401720 Sep 13 16:01:55.638085 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 32/64] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Sep 13 16:01:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:01:55.659227 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_api:SELECT=14 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:01:55.663319 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-2987aa66-4f70-4a93-a032-13376ef663a0 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:01:55.670983 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-2987aa66-4f70-4a93-a032-13376ef663a0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013594 Sep 13 16:01:55.671503 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 33/65] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Sep 13 16:01:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:01:55.683697 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-996ffb65-1e18-42d3-b307-0dd5a1c1c1af admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:01:55.691041 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-996ffb65-1e18-42d3-b307-0dd5a1c1c1af admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010891 Sep 13 16:01:55.691556 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 33/66] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Sep 13 16:01:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:01:55.703436 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:01:55.710634 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010680 Sep 13 16:01:55.711177 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 34/67] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Sep 13 16:01:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:01:55.722073 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-aeee4605-5b4d-4b69-8fe3-c3e59d9d10cc admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:01:55.729396 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-aeee4605-5b4d-4b69-8fe3-c3e59d9d10cc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010808 Sep 13 16:01:55.729901 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 34/68] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Sep 13 16:01:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:04:56.723042 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:04:56.724056 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 13 16:04:56.724447 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 35/69] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:04:56.864691 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_api:SELECT=6 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:04:57.022835 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:04:57.028868 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:04:57.029348 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:04:57.029776 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:04:57.030485 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:04:57.030954 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:04:57.031374 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:04:57.064485 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-deb5f80d-5f85-437d-9f70-157be653fc16 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.200880 Sep 13 16:04:57.065053 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 35/70] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Sep 13 16:04:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:04:58.149931 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:04:58.150953 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 13 16:04:58.151352 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 36/71] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:04:58.341977 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:04:58.345434 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:04:58.345915 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:04:58.346347 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:04:58.347105 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:04:58.347557 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:04:58.347976 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:04:58.368016 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-711d9dd2-399e-4ca5-9973-1a241539b33d admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077928 Sep 13 16:04:58.368556 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 36/72] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Sep 13 16:04:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:05:09.876925 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:05:09.877946 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 13 16:05:09.878366 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 37/73] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:05:10.020920 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_cell0:SELECT=4 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:05:10.021631 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_cell1:SELECT=4 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:05:10.022306 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG dbcounter [-] [105648] Writing DB stats nova_api:SELECT=8 {{(pid=105648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:05:10.071199 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:05:10.074608 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:05:10.075122 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:05:10.075589 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:05:10.076307 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:05:10.076758 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:05:10.077180 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:05:10.103183 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-e376911f-0c89-441f-a848-7fe2009959d6 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.086796 Sep 13 16:05:10.103652 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 37/74] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Sep 13 16:05:10 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:05:11.166926 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG nova.api.openstack.wsgi [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] Calling method '>' {{(pid=105647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:05:11.167922 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: INFO nova.api.openstack.requestlog [None req-46645248-2c77-4784-b1ce-6c85359c0219 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 13 16:05:11.168317 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: [pid: 105647|app: 0|req: 38/75] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Sep 13 16:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:05:11.357671 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG nova.api.openstack.wsgi [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Calling method '>' {{(pid=105648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:05:11.361109 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:05:11.361596 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:05:11.362029 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:05:11.362749 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:05:11.363238 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:05:11.363664 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: DEBUG oslo_concurrency.lockutils [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:05:11.386035 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: INFO nova.api.openstack.requestlog [None req-40443d7f-b312-4689-b504-17bf6434c388 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.080172 Sep 13 16:05:11.386585 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: [pid: 105648|app: 0|req: 38/76] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Sep 13 16:05:11 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:06:07.386112 dv-cinder-820027-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 16:06:07.386648 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: Tue Sep 13 16:06:07 2022 - graceful shutdown triggered... Sep 13 16:06:07.387102 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: Gracefully killing worker 1 (pid: 105647)... Sep 13 16:06:07.387604 dv-cinder-820027-28-iscsi devstack@n-api.service[105648]: Gracefully killing worker 2 (pid: 105648)... Sep 13 16:06:07.513128 dv-cinder-820027-28-iscsi devstack@n-api.service[105647]: DEBUG dbcounter [-] [105647] Writing DB stats nova_api:SELECT=4 {{(pid=105647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:08.387017 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: worker 1 buried after 1 seconds Sep 13 16:06:08.387561 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: worker 2 buried after 1 seconds Sep 13 16:06:08.387561 dv-cinder-820027-28-iscsi devstack@n-api.service[105646]: goodbye to uWSGI. Sep 13 16:06:08.388570 dv-cinder-820027-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 16:06:08.389115 dv-cinder-820027-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 16:06:08.392138 dv-cinder-820027-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 16:06:08.401895 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 16:06:08 2022] *** Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: nodename: dv-cinder-820027-28-iscsi Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: machine: x86_64 Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: clock source: unix Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: pcre jit disabled Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: detected number of CPU cores: 4 Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: current working directory: / Sep 13 16:06:08.403987 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: detected binary path: /usr/bin/uwsgi-core Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: your processes number limit is 47680 Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: your memory page size is 4096 bytes Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: detected max file descriptor number: 2048 Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: lock engine: pthread robust mutexes Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: thunder lock: enabled Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 16:06:08.404661 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 16:06:08.444281 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: Python main interpreter initialized at 0x558e7d1359c0 Sep 13 16:06:08.444281 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: python threads support enabled Sep 13 16:06:08.444281 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: your server socket listen backlog is limited to 100 connections Sep 13 16:06:08.444281 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: your mercy for graceful operations on workers is 90 seconds Sep 13 16:06:08.444703 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 16:06:08.444703 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: *** Operational MODE: preforking *** Sep 13 16:06:08.444973 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: *** uWSGI is running in multiple interpreter mode *** Sep 13 16:06:08.444973 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: spawned uWSGI master process (pid: 120625) Sep 13 16:06:08.445178 dv-cinder-820027-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 16:06:08.446028 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: spawned uWSGI worker 1 (pid: 120637, cores: 1) Sep 13 16:06:08.447066 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: spawned uWSGI worker 2 (pid: 120638, cores: 1) Sep 13 16:06:08.447420 dv-cinder-820027-28-iscsi devstack@n-api.service[120625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 16:06:09.126864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 16:06:09.128720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 16:06:10.296305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:06:10.296305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: from cryptography.utils import int_from_bytes Sep 13 16:06:10.296954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:06:10.296954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: from cryptography.utils import int_from_bytes Sep 13 16:06:10.311906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:06:10.311906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Sep 13 16:06:10.312545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:06:10.312545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Sep 13 16:06:12.722533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 16:06:12.723152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 16:06:12.723484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 16:06:12.723672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 16:06:12.723927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 16:06:12.724333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.724655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.724983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.725305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.725802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.726005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.726283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.726611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.726972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.727241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.727562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.728077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-28-iscsi {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.728416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.728735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.729055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.729385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.729698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.730030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.730359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.730881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.732414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.732414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.732414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.732414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.732741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.732966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.733219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.733544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.733867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.734196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.734614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-28-iscsi {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.734951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.735274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.735586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.736018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.736457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.736754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.737095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.737411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.737722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.738051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.738377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.738696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.739046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.739353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.739666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.739978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.740302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.740614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.740925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.741178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.741487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.741843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.742133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.742461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.742717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.742993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.743318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.743640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.743954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.744264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.744580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.744894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.745200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.745509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.745817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.746126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.746450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.746768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.747129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.747435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.747760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.748168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.748425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.748737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.749086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.749411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.749720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.750043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.750366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.750683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.751017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.751330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.751655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.752537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.752846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.753106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.753467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.753717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.754042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.754351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.754660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.754923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 16:06:12.755380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.755475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 16:06:12.755574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.755574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.755725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 16:06:12.755947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.756101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 16:06:12.756201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.756342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 16:06:12.756498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.756733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.756883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.757975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.758116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.758265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.758427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.758569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.758706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.758879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.759082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.759232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.759407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.759563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.759710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.759851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-28-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.760988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.761135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.761286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.761443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.761601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.761750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.761897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.762044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.762184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.762323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.762472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.762620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.762925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.763098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.763275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.763427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.763585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.763734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.763896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.764243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.764395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.764552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.764933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.765449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.765603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.765793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.766027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.767038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.767210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.767366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.768551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.769167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.769329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.769611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.770148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.770148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.770451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-28-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.771034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.771273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.771552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.771708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.771864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.772137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.772137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.772735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.772735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.773303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.773621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.773981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.774398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.780333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.780461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.780903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.781008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.781097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.782002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.782230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.782318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.782393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.782498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.782585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.782670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.782750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.784030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.784297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.784919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.785092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.785564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.785726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.785915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.786074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.786229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.786590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.786983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.787766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.787899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.788007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.788128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.788250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.788369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.788492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.788627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.788766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.788925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.789067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.789203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.789332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.789470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.789608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.789785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.789906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.789988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.790067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.790152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.790249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.790249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.790418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.790503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.790593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.790676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.790772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.790865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.791013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.791101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.791187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.791267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.791366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.791461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.791553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.791642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.791723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.791804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.791883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.791955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.792026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.792026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.792187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.792270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.792343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.792427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.792518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.792605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.792687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.792779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.792871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.792962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.793054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.793226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.793385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.793602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.793772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.793929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.793999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.794068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.794163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.794266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.794375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.794375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.794515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.794515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.794711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.794793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.794879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.795046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.795046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.795198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.795350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.795425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.795504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.795583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.795662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.795740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.795824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.795904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.795975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.796125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.796281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.796431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.796578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.796730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.796877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.796955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.797116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.797266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.797430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.797589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.797754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.797912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.797984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.798060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.798147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.798227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.798307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.798391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.798464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.798535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.798612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.798748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.798864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.799078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.799237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.799392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.799549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.799699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.799858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.799938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.800897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.800976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.801945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.801945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.802090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.802169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.802241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.802311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.802391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.802477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.802550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.802744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.802875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.803105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:06:12.803449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.803674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.803775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.804122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.804376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.804490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.804816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.805093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.805413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.805578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.805739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.805889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.806114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.806285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.806586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.806751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.806978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.807402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.807566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.807724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.807878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.808030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.808190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.808349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.808495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.808646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.809992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.810296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.810450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.810608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.810786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.811021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.811171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.811315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.811472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.811636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.811789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.812003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.812167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.812379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.812669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.812804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.812804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.813533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.813804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.813959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.814114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.814259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.815421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.815579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.815724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.815907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.816200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.816355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.816500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.816643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.816786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.816928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.817081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.817226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.817376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.817528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.817671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.817821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.818964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.819124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.819270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.819418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.819569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.819727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.819882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.820930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.821972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.822121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.822274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.822426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.822580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.822724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.822874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.823051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.823525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.823787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.823949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.824094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.824260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.824413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.824568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.824720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.824864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.825063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.825439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.825605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.825763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.825916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.826068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.826299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.826458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.826629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.826782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.826983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.827135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.827287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.827447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.827650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.827807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.827959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.828110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.828257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.828407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.828567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.828724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.828875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.829019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.829168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.829311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.829463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.829607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.829751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.830157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.830812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.830985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.831164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.831312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.831466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.831620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.831765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.831925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.832977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.833120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.833591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.833758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.834948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.835102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.835271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.835668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.835830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.835994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.836149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.836320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.836534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.836690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.836841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.836993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.837151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.837302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.837461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.837612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.837756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.837907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.838076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.838239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.838391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.838534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.838677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.838828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.839907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.840960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.841995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.842146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.842299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.842454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.842605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.842756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.842936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.843099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.843244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.843407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.843834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.844006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.844260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.844411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.844565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.844716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.844866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.845010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.845167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.845312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.845455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.845898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.846058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.846218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.846371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.846553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.846775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.847899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.848049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.848280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.848439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.849206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.849367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.849513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.849656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.849807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.849951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.850104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.850248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.850248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.850519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.850662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.850812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.851881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.852899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.853043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.853185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.853328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.853497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.854023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.854185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.854461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.854613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.854765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.854961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.855115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.855271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.855426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.855579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.855749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.856161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.856161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.856454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.856597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.856760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.857917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.858063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.858456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.858618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.858764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.858935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.859106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.859255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.859406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.859550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.859694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.859862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.860910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.861060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.861272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.861435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.861587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.861747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.861910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.862100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.862293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.862456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.862608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.862761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.862960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.863123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.863275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.863421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.863575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.863735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.864255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.864412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.864691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.864850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.865906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.866349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.866512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.866676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.866830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.867093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.867292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.867456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.867602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.867752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.867895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.868826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.869118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.869269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.869421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.869565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.869716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.869868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.870999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.871150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.871294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.871447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.871592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.871750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.871903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.872941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.873998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.874481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.874481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.874976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.875154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.875309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.875462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.875613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.875766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.875912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.876055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.876386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.876637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.877375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.877696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.877908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.878068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.878258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.878438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.878592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.878738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.878881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.879955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.880101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.880262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.880414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.880557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.880700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.880858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.881969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.882113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.882267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.882418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.882562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.882718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.882863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.883922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.884958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.885963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.886981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.887929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.888947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.889920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.890073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.890488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.890634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.890777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.890971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.891124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.891276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.891419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.891581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.891736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.891882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.892032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.892183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.892333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.893950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.894996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.895933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.896245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.896339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.896453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.897585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.897731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.897849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.897964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.898856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.899946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.900981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.901300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.901410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.901636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.901945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.902044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.902267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.902589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.902688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.902946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.903185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.903285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.903544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.903752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.903880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.904194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.904373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.905782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.906054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.906151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.906452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.906555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.906774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.906881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.907110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.907233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.907424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.907577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.907780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.907881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.908115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.908372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.908542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.908948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.909044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.909289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.909401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.909621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.909724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.910019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.910113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.910363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.910474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.910719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.910865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.911054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.911168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.911379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.911474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.911703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.911805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.912949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.913976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.914190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.914284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.914498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.914600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.914808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.914934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.915160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.915344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.915470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.915579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.915801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.915898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.916119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.916213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.916431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.916534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.916742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.916883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.917055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.917150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.917378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.917484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.917726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.917872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.918104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.918239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.918371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.918516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.918651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.918747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.919970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.920078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.920287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.920389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.920596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.920689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.920913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.921962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.922181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.922277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.922525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.922763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.922864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.923132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.923244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.923455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.923551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.924377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.924488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.924698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.925966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.926060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.926283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.926426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.926600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.926751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.926958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.927092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.927292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.927520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.927628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.927843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.927973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.928161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.928274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.928489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.928601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.928818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.928926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.929150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.929249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.929462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.929573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.929780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.929887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.930095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.930201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.930426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.930526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.930754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.930854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.931095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.931205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.931420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.931529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.931729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.931830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.932994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.933113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.933310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.933411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.933626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.933727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.933957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.934067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.934299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.934407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.934626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.934727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.934965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.935100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.935288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.935411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.935611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.935720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.935999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.936156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.936304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.936449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.936626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.936781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.936942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.937119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.937265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.937420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.937567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.937720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.937984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.938145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.938292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.938438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.938591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.938747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.938972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.939136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.939336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.940935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.941080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.941260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.941420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.941568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.941721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.941868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.942015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.942183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.942382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.942541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.942689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.942865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.943994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.944142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.944305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.944451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.944605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.944775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.944948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.945098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.945243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.945403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.945636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.945797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.945958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.946112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.946270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.946416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.946568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.946728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.946983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.947138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.947287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.947431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.947577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.947735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.947889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.948137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.948318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.948491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.948648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.948808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.948963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.949109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.949254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.949406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.949566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.949722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.949870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.950999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.951894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.952176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.952510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.952692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.952848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.953917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.954070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.954216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.954438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.954598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.954752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.954975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.955133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.955297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.955444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.955599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.955599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.955876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.956930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.957974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.958156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.958309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.958463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.958626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.958788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.958969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.959122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.959268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.959413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.959566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.959721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.959876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.960953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.961997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.962142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.962306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.962462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.962608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.962759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.962951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.963116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.963277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.963425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.963574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.963735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.963735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.964930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.965085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.965238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.965384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.965527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.965757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.965920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.966068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.966224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.966369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.966555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.966719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.966867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.967966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.968128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.968276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.968428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.968587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.968736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.968889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.969958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.970252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.970406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.970585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.970737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.970883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.971113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.971285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.971440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.971594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.971741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.971920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.972095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.972251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.972396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.972584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.972739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.972885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.973957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.974113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.974259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.974403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.974670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.974839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.975966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.976134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.976287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.976448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.976608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.976774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.976935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.977087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.977087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.977397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.977550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.977711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.977864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.978022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.978184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.978342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.978494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.978659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.978812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.979970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.980120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.980290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.980451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.980611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.980772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.980933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.981092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.981244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.981404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.981564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.981723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.981883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.982034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.982196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.982360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.982523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.982675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.982834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.983982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.984917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.985218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.985323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.985525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.985643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.985836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.986007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.986712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.986883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.987103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.987315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.987484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.987638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.987832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.988959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.989109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.989261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.989411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.989571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.989731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.989883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.990041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.990195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.990355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.990516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.990668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.990819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.991013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.991218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.991384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.991552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.991712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.991866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.992963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.993124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.993287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.993448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.993600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.993765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.993917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.994067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.994227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.994392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.994544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.994702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.994854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.995051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.995213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.995367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.995527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.995687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.995866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.996033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.996194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.996346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.996509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.996509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 16:06:12.996814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.996814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.997129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.997349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.997663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.997975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.998292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.998634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.998981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.999304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.999623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:12.999940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.000254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.000567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.000877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.001187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.001506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.002390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.002964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.003378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.003808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.004125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.004448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.004774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.005086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.005410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.005734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.006046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.006370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.006682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.007039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.007379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.007709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.008037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.008343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.008650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.008955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.009317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.009582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.009893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.010195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.010499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.010808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.011135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.011440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.011743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.012050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.012355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.012658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.012962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.013266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.013569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.013872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.014177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.014483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.014787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.015381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.015686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.015992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.016294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.016624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.017103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.017348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.017971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.018346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.018678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.019022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.019351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.019677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.019995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.020308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.020647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.020962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.021276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.021590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.021903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.022221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.022533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.022863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.023213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.023521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.023846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.024165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.024486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.024802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.025114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.025445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.025758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.026068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.026379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.026692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.027030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.027350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.027662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.027973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.028289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.028608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.028938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.029264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.029574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.029903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.030230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.030577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.030891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.031258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.031585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.031901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.032219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.032526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:06:13.032768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 16:06:13.059365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Registered counter for database nova_api Sep 13 16:06:13.080087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.087049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.096661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Registered counter for database nova_api Sep 13 16:06:13.117248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.123740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.144410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.context [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3524178c-5c28-4931-8ce8-d0486ae70a8d(cell1) {{(pid=120638) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 16:06:13.148491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:06:13.148965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:06:13.150556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:06:13.151371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:06:13.151821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:06:13.153832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:06:13.155846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Registered counter for database nova_cell0 Sep 13 16:06:13.159854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Registered counter for database nova_cell1 Sep 13 16:06:13.166957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.171076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.172631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.180698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.context [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3524178c-5c28-4931-8ce8-d0486ae70a8d(cell1) {{(pid=120637) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 16:06:13.184748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:06:13.185225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:06:13.186799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:06:13.187559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:06:13.188010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:06:13.190739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:06:13.192760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Registered counter for database nova_cell0 Sep 13 16:06:13.196808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Registered counter for database nova_cell1 Sep 13 16:06:13.204521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.207076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.212152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.214796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.315476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.324026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Registered counter for database nova_cell0 Sep 13 16:06:13.331022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.336247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.362459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Registered counter for database nova_cell0 Sep 13 16:06:13.371068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:06:13.375814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:06:13.652953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:06:13.660731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:06:13.696063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:06:13.703396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:06:14.015435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:06:14.021962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-2a1655e9-0689-4703-9487-2394aefb354d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:06:14.027324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e7d1359c0 pid: 120638 (default app) Sep 13 16:06:14.050800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:06:14.056849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-70109c04-a2eb-426a-8535-cd5d6a3680a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:06:14.062240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e7d1359c0 pid: 120637 (default app) Sep 13 16:06:49.388080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:49.389864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:49.390572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:49.391724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:50.486292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef28af4e-10f4-4304-9195-69e399323fb6 tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Action: 'create', calling method: .version_select at 0x7fb67d1b64c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-387835599", "metadata": {"Type": "work"}}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:06:50.672355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:50.674130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:50.675166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:50.676403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:06:52.125130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-530c396a-cb34-4864-a76e-35437fefde76 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Action: 'create', calling method: .version_select at 0x7fb67d1b64c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1322871523"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:06:53.196897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef28af4e-10f4-4304-9195-69e399323fb6 tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.824101 Sep 13 16:06:53.198133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Sep 13 16:06:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3827 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 16:06:53.213203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-447425a6-08e0-4695-94e0-89a7754a5b1d tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Calling method '.version_select at 0x7fb67d0893a0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:53.377256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-447425a6-08e0-4695-94e0-89a7754a5b1d tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6" status: 200 len: 352 microversion: 2.1 time: 0.168216 Sep 13 16:06:53.377849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:53 2022] GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:06:53.607699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-530c396a-cb34-4864-a76e-35437fefde76 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.947537 Sep 13 16:06:53.619440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Sep 13 16:06:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2961 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 16:06:53.625330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffa27f57-af7a-47fd-97f5-7c51c9ef117a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d089a60>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:53.729728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffa27f57-af7a-47fd-97f5-7c51c9ef117a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 200 len: 345 microversion: 2.1 time: 0.109377 Sep 13 16:06:53.730638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:53 2022] GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:54.394368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c32fa96-006b-4217-967a-b4b46380245f tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Calling method '.version_select at 0x7fb67d0873a0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:54.464529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c32fa96-006b-4217-967a-b4b46380245f tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6" status: 200 len: 353 microversion: 2.1 time: 0.075310 Sep 13 16:06:54.465848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 2/5] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:54 2022] GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:06:54.479778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0f13600-a08a-4d6e-aef4-af5e288ed598 tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Calling method '.version_select at 0x7fb67d0241f0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:54.542070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0f13600-a08a-4d6e-aef4-af5e288ed598 tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6" status: 200 len: 353 microversion: 2.1 time: 0.066377 Sep 13 16:06:54.542595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 4/6] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:54 2022] GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:06:54.577149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-797aa8f2-2588-4207-bc80-0e87e278191a tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Calling method '.version_select at 0x7fb67d087af0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:54.711308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-797aa8f2-2588-4207-bc80-0e87e278191a tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6" status: 202 len: 0 microversion: 2.1 time: 0.153351 Sep 13 16:06:54.715200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:06:54 2022] DELETE /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:06:54.721904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed240db1-cb58-47ee-a2be-c46cdabb81d7 tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Calling method '.version_select at 0x7fb67d089b80>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:54.750324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af58b121-bcd7-4e8c-afcd-a8bb93e92585 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d0211f0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:54.858308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed240db1-cb58-47ee-a2be-c46cdabb81d7 tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6" status: 200 len: 352 microversion: 2.1 time: 0.140513 Sep 13 16:06:54.868963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af58b121-bcd7-4e8c-afcd-a8bb93e92585 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 200 len: 346 microversion: 2.1 time: 0.121535 Sep 13 16:06:54.880962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:54 2022] GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:54.882985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 4/9] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:54 2022] GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:54.894859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edecf953-3f58-437f-a835-e2dff7e246fb tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Action: 'create', calling method: .version_select at 0x7fb67d089670>, body: {"snapshot": {"volume_id": "fb011d24-3fa5-4d9e-8f09-e9766ae57d91", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-802255164"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:06:55.466128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edecf953-3f58-437f-a835-e2dff7e246fb tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.582891 Sep 13 16:06:55.467783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 6/10] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Sep 13 16:06:54 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:55.479296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1eb0ac9-25a3-44e4-abad-7811d8d059aa tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d087c10>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:55.735683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1eb0ac9-25a3-44e4-abad-7811d8d059aa tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 200 len: 286 microversion: 2.1 time: 0.260314 Sep 13 16:06:55.742258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 5/11] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:06:55 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:55.768998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-98b901c9-aacf-4c81-9a9a-6fd031fe28fd tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d024ca0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:55.830429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-98b901c9-aacf-4c81-9a9a-6fd031fe28fd tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.081450 Sep 13 16:06:55.831671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 7/12] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Sep 13 16:06:55 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:06:55.848795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-019db4c8-b1ce-4121-89ad-1d37c7c711dc tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d0875e0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:55.880628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b6e8f34-d3bb-41d9-bc08-cf4efd9b353e tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Calling method '.version_select at 0x7fb67d0893a0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:55.905106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-019db4c8-b1ce-4121-89ad-1d37c7c711dc tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 200 len: 286 microversion: 2.1 time: 0.063656 Sep 13 16:06:55.908206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 6/13] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:06:55 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:06:55.929841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-6b6e8f34-d3bb-41d9-bc08-cf4efd9b353e tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] HTTP exception thrown: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b6e8f34-d3bb-41d9-bc08-cf4efd9b353e tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Request method failure captured: Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 HTTP/1.1 Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqZm5Hi_3XbUXHBXkQtgOIOBo4DWNyAlmnQ1ZYuoDCLSkwCK4NFx-nZxx6C3ugULsp6LNA6D4GP7jMJmBwghc5fDBl-gW3CeFrzXlOoiJtKEVuRGGK1nUAsSkgUaRF-jwwFUrgi-11ny_F-fkOeXuSgYf8vMc4NN7NNhuQjJpxFsec Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8be8793418084985bce6350626212347 Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesGetTestJSON-1743072833 Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:06:55.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8be8793418084985bce6350626212347"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8be8793418084985bce6350626212347"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8be8793418084985bce6350626212347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8be8793418084985bce6350626212347"}]}] Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesGetTestJSON-1743072833 Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8be8793418084985bce6350626212347 Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesGetTestJSON-1743072833 Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesGetTestJSON-1743072833-project Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: ff06e46c42034f59b393ce213830cfa5 Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesGetTestJSON-1743072833-project Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'f4171020-583e-49aa-bca2-5aa3b74defa6'} Sep 13 16:06:55.939135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. (HTTP 404) (Request-ID: req-d0db4188-7f21-44cd-ba17-5444d6b05a0b) Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:06:55.939923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:06:55.940985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 16:06:55.943074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. Sep 13 16:06:55.944246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:06:55.946800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b6e8f34-d3bb-41d9-bc08-cf4efd9b353e tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] Returning 404 to user: Volume f4171020-583e-49aa-bca2-5aa3b74defa6 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:06:55.948374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b6e8f34-d3bb-41d9-bc08-cf4efd9b353e tempest-VolumesGetTestJSON-1743072833 tempest-VolumesGetTestJSON-1743072833-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6" status: 404 len: 109 microversion: 2.1 time: 0.072171 Sep 13 16:06:55.968326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 8/14] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:06:55 2022] GET /compute/v2.1/os-volumes/f4171020-583e-49aa-bca2-5aa3b74defa6 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:06:56.920447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8a8187c-93f5-43dc-845b-2e5ed5a8a859 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d0213a0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:56.964901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8a8187c-93f5-43dc-845b-2e5ed5a8a859 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 200 len: 286 microversion: 2.1 time: 0.049248 Sep 13 16:06:56.970953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 7/15] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:06:56 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:57.986570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea8c60db-202d-425b-bcd7-38e1a1f459eb tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d089820>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:58.036578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea8c60db-202d-425b-bcd7-38e1a1f459eb tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 200 len: 286 microversion: 2.1 time: 0.061667 Sep 13 16:06:58.037541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 9/16] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:06:57 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:59.049662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8850a70f-51ef-455c-8ee0-a9c293893de8 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d087550>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:59.133486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8850a70f-51ef-455c-8ee0-a9c293893de8 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 200 len: 287 microversion: 2.1 time: 0.087439 Sep 13 16:06:59.134052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 8/17] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:06:59 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:06:59.146322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdd858b1-4766-4b10-befa-5a4b35d1b4fb tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d9e28b0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:59.258124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bdd858b1-4766-4b10-befa-5a4b35d1b4fb tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 202 len: 0 microversion: 2.1 time: 0.115784 Sep 13 16:06:59.259539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 10/18] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Sep 13 16:06:59 2022] DELETE /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:06:59.272508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba809209-dc3c-4e64-b7af-68ad8fb86164 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d087d30>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:06:59.314361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba809209-dc3c-4e64-b7af-68ad8fb86164 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 200 len: 286 microversion: 2.1 time: 0.049438 Sep 13 16:06:59.315615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 9/19] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:06:59 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:00.329930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59cdd853-b02b-43d0-8857-738ef7e0e14a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d01a700>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:00.382525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-59cdd853-b02b-43d0-8857-738ef7e0e14a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] HTTP exception thrown: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59cdd853-b02b-43d0-8857-738ef7e0e14a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Request method failure captured: Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db HTTP/1.1 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqaj3ouQjzkgp_2RmUy7uzoC8bbNvwnER9XclenoaDdBKSccQasC_3i-tuiJvm2EQBmb3GDbhzhpGDO5WiNJc-6wkkGjR4WYpqyvxEc4zrkprMmVl32DSwd76ckS6eueK4ZiDOq89qMkFUfZM1aGLJ2aotH7yyPO472MB6D0RMuNM4 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:07:00.385219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e907c12bca4b4205a4877e3c6596db16"}]}] Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 5d421769b0c84034b83f6336f71d72bf Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '4331c614-3408-4d2b-a763-feace54e06db'} Sep 13 16:07:00.386214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. (HTTP 404) (Request-ID: req-1e1fd8e5-0ee3-476b-be61-c970a4509cad) Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.387190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:07:00.389016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 16:07:00.390014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59cdd853-b02b-43d0-8857-738ef7e0e14a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Returning 404 to user: Snapshot 4331c614-3408-4d2b-a763-feace54e06db could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:07:00.391536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59cdd853-b02b-43d0-8857-738ef7e0e14a tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db" status: 404 len: 111 microversion: 2.1 time: 0.063234 Sep 13 16:07:00.397958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-becc95fe-d882-46bf-b537-00a331d22d07 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d0218b0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:00.403968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 11/20] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:07:00 2022] GET /compute/v2.1/os-snapshots/4331c614-3408-4d2b-a763-feace54e06db => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:07:00.573938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-becc95fe-d882-46bf-b537-00a331d22d07 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 202 len: 0 microversion: 2.1 time: 0.180045 Sep 13 16:07:00.578333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 10/21] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:07:00 2022] DELETE /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:07:00.587082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f015cf71-473c-49aa-8fe3-4160b51ae512 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d024550>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:00.700686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f015cf71-473c-49aa-8fe3-4160b51ae512 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 200 len: 345 microversion: 2.1 time: 0.120663 Sep 13 16:07:00.702035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 12/22] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:07:00 2022] GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:07:01.717282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff3e3ced-2cd0-4ac7-82d9-945f45ed779b tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d021940>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:01.788595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-ff3e3ced-2cd0-4ac7-82d9-945f45ed779b tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] HTTP exception thrown: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff3e3ced-2cd0-4ac7-82d9-945f45ed779b tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Request method failure captured: Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 HTTP/1.1 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKqaj3ouQjzkgp_2RmUy7uzoC8bbNvwnER9XclenoaDdBKSccQasC_3i-tuiJvm2EQBmb3GDbhzhpGDO5WiNJc-6wkkGjR4WYpqyvxEc4zrkprMmVl32DSwd76ckS6eueK4ZiDOq89qMkFUfZM1aGLJ2aotH7yyPO472MB6D0RMuNM4 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:07:01.794522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e907c12bca4b4205a4877e3c6596db16"}]}] Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 5d421769b0c84034b83f6336f71d72bf Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'fb011d24-3fa5-4d9e-8f09-e9766ae57d91'} Sep 13 16:07:01.795806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. (HTTP 404) (Request-ID: req-92dfa05f-912c-4219-ba45-71e037f191a3) Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:01.796441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:07:01.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 16:07:01.798240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.799206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.801017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff3e3ced-2cd0-4ac7-82d9-945f45ed779b tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Returning 404 to user: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:07:01.802090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff3e3ced-2cd0-4ac7-82d9-945f45ed779b tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 404 len: 109 microversion: 2.1 time: 0.090165 Sep 13 16:07:01.818744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:07:01 2022] GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:07:01.825171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2ef229f-26ac-486a-a2a1-d1f3a3696ba6 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d01a9d0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:01.915551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-a2ef229f-26ac-486a-a2a1-d1f3a3696ba6 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] HTTP exception thrown: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2ef229f-26ac-486a-a2a1-d1f3a3696ba6 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Request method failure captured: Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 HTTP/1.1 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqaj3ouQjzkgp_2RmUy7uzoC8bbNvwnER9XclenoaDdBKSccQasC_3i-tuiJvm2EQBmb3GDbhzhpGDO5WiNJc-6wkkGjR4WYpqyvxEc4zrkprMmVl32DSwd76ckS6eueK4ZiDOq89qMkFUfZM1aGLJ2aotH7yyPO472MB6D0RMuNM4 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:07:01.917422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e907c12bca4b4205a4877e3c6596db16"}]}] Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 5d421769b0c84034b83f6336f71d72bf Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'fb011d24-3fa5-4d9e-8f09-e9766ae57d91'} Sep 13 16:07:01.918627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. (HTTP 404) (Request-ID: req-a87f67c5-652f-4942-8d88-0fc05fcaeafb) Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:01.920283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 16:07:01.921743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 16:07:01.923693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:01.925484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:07:01.929684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2ef229f-26ac-486a-a2a1-d1f3a3696ba6 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Returning 404 to user: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:07:01.930731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a2ef229f-26ac-486a-a2a1-d1f3a3696ba6 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 404 len: 109 microversion: 2.1 time: 0.112604 Sep 13 16:07:01.931876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 13/24] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:07:01 2022] DELETE /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:07:01.945159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-239a87bf-0981-42c7-b9ef-1e85aea9e985 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Calling method '.version_select at 0x7fb67d021820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:02.044944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-239a87bf-0981-42c7-b9ef-1e85aea9e985 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] HTTP exception thrown: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-239a87bf-0981-42c7-b9ef-1e85aea9e985 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Request method failure captured: Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 HTTP/1.1 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKqaj3ouQjzkgp_2RmUy7uzoC8bbNvwnER9XclenoaDdBKSccQasC_3i-tuiJvm2EQBmb3GDbhzhpGDO5WiNJc-6wkkGjR4WYpqyvxEc4zrkprMmVl32DSwd76ckS6eueK4ZiDOq89qMkFUfZM1aGLJ2aotH7yyPO472MB6D0RMuNM4 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:07:02.047257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e907c12bca4b4205a4877e3c6596db16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e907c12bca4b4205a4877e3c6596db16"}]}] Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: e907c12bca4b4205a4877e3c6596db16 Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024958519 Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 5d421769b0c84034b83f6336f71d72bf Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024958519-project Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'fb011d24-3fa5-4d9e-8f09-e9766ae57d91'} Sep 13 16:07:02.048312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. (HTTP 404) (Request-ID: req-4e6dc8f0-cc00-4127-a1c0-05f46463c24d) Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:02.049010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:07:02.049889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 16:07:02.050783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. Sep 13 16:07:02.051681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:07:02.053125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-239a87bf-0981-42c7-b9ef-1e85aea9e985 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] Returning 404 to user: Volume fb011d24-3fa5-4d9e-8f09-e9766ae57d91 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:07:02.054374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-239a87bf-0981-42c7-b9ef-1e85aea9e985 tempest-VolumesSnapshotsTestJSON-2024958519 tempest-VolumesSnapshotsTestJSON-2024958519-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91" status: 404 len: 109 microversion: 2.1 time: 0.116326 Sep 13 16:07:02.055198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 12/25] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:07:01 2022] GET /compute/v2.1/os-volumes/fb011d24-3fa5-4d9e-8f09-e9766ae57d91 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:07:06.834604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1187335754", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "networks": [{"uuid": "4d8bb9ba-f9e8-4293-8a75-063caec87b38"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:06.995444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1e6a51b-e46b-4a8a-967a-941f117d5930 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'create', calling method: .version_select at 0x7fb67d021d30>, body: {"keypair": {"name": "tempest-keypair-1316772910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLWQj76Eo5ino6RhS3Yo8dST3RbqmlNg39AidHpzCvBYp4wr0AxtgFWllMRWs6fS9IoYOV/rwEyZmhiYeEUY6kyXJi5n6TWashVjBtxjIBbUTyYCXeFFNFIIjA4iBAddQ=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:07.146870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] validate_networks() for [('4d8bb9ba-f9e8-4293-8a75-063caec87b38', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:07:07.171969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e1e6a51b-e46b-4a8a-967a-941f117d5930 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for project 4eb7191b18cc41de8c9c51672246991d. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:07.187241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e1e6a51b-e46b-4a8a-967a-941f117d5930 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for user e1cbafa1d3c244c5906e475494b39d4c and project 4eb7191b18cc41de8c9c51672246991d. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:07.300352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1e6a51b-e46b-4a8a-967a-941f117d5930 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.221001 Sep 13 16:07:07.302390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 13/26] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:07:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:08.453906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36cf4b0f-0559-45a0-83e1-413206b042d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'create', calling method: .version_select at 0x7fb67cf5e310>, body: {"keypair": {"name": "tempest-keypair-1501695922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEsr9PDg/65+uvzb6PBMVEiyNml8ef/quGoP6dui9IMxaTmrD9YQ8gGusZ/fKZO4hmOkanzu0K/vPnsB9vf99ZKFesNP1CqHr1NZcDo/BeQj0yYAFFFlf6xUvMmVKYFdw=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:08.496871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-36cf4b0f-0559-45a0-83e1-413206b042d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for project 859cfa45a18845f49e525ab4ed54b529. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:08.514947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-36cf4b0f-0559-45a0-83e1-413206b042d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for user c0fd4bbe430b4a8888f3be4b23982c5a and project 859cfa45a18845f49e525ab4ed54b529. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:08.570016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36cf4b0f-0559-45a0-83e1-413206b042d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.761911 Sep 13 16:07:08.572127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 14/27] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Sep 13 16:07:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 765 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 13 16:07:09.632882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:07:09.633352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:07:09.633979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:07:09.634809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:07:09.635404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:07:09.711628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:09.712183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:09.714478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:09.720729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:09.723833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:09.724392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:09.829999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Getting quotas for project a345ae605d56441e86b2dd45565655c5. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:09.844495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Getting quotas for user 179e2ae27b924db0a49b64502548525a and project a345ae605d56441e86b2dd45565655c5. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:09.872831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:07:09.876357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:07:10.047152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-409a551b-015a-4186-8072-5e51e5794a33 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.223108 Sep 13 16:07:10.049336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 14/28] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:07:10.062810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbbdac20-1f41-40dc-a150-5e48056c78ae tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:10.064133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbbdac20-1f41-40dc-a150-5e48056c78ae tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:10.484983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbbdac20-1f41-40dc-a150-5e48056c78ae tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:10.523399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbbdac20-1f41-40dc-a150-5e48056c78ae tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1215 microversion: 2.1 time: 0.462309 Sep 13 16:07:10.536662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 15/29] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:10 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:11.548460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee9aa208-b565-4cb9-a495-7c06b94ff1c3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:11.549131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee9aa208-b565-4cb9-a495-7c06b94ff1c3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:11.910700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee9aa208-b565-4cb9-a495-7c06b94ff1c3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:11.919082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee9aa208-b565-4cb9-a495-7c06b94ff1c3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1215 microversion: 2.1 time: 0.373727 Sep 13 16:07:11.919671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 16/30] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:11 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1215 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:12.147844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-167524619", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:12.296269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] validate_networks() for [('89b1e5ec-b396-4707-8f39-b8104959eeb7', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:07:12.942930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52f3fe34-b866-4775-9890-6fc049ba96a4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:12.943562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52f3fe34-b866-4775-9890-6fc049ba96a4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:13.091922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52f3fe34-b866-4775-9890-6fc049ba96a4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:13.103255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52f3fe34-b866-4775-9890-6fc049ba96a4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1215 microversion: 2.1 time: 0.164220 Sep 13 16:07:13.109861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 17/31] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:12 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:13.279817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1366025398", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f1df069-b219-4388-80e0-212b82e58fde"}], "security_groups": [{"name": "tempest-securitygroup--226527599"}], "key_name": "tempest-keypair-1316772910", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:13.444431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:07:13.445476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:07:13.446132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:07:13.446731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:07:13.447335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:07:13.473269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:13.473766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:13.474214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:13.486319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:13.487099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:13.487563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:13.557341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for project 5b11b198b8754bcabf244e0047475b8d. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:13.575962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for user 6d31b2ec391441f7bab3546d2354b0a1 and project 5b11b198b8754bcabf244e0047475b8d. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:13.641073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:07:13.652829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:07:13.685366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] validate_networks() for [('6f1df069-b219-4388-80e0-212b82e58fde', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:07:13.763206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe9867a2-83ff-4e96-b312-f0f8d9b4ab9c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.509388 Sep 13 16:07:13.764395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 15/32] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:07:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:07:13.777892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf336f14-1f83-4577-86f7-e17bd3fb246c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:13.778628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf336f14-1f83-4577-86f7-e17bd3fb246c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:14.071024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cf336f14-1f83-4577-86f7-e17bd3fb246c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:14.108248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf336f14-1f83-4577-86f7-e17bd3fb246c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1221 microversion: 2.1 time: 0.333307 Sep 13 16:07:14.108915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 16/33] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:13 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1221 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:14.162446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:14.163024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:14.199412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:14.210430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:14.211049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:14.212753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:14.214757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:14.215836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:14.586176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:14.615936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37e17066-a4ac-4808-ad26-06cd9b967c3f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1267 microversion: 2.1 time: 0.479789 Sep 13 16:07:14.639088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 17/34] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:14 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1267 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:14.670751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2003950323", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7a71916-0d63-4fd1-9b48-ca6da518cd37"}], "security_groups": [{"name": "tempest-securitygroup--1315798989"}], "key_name": "tempest-keypair-1501695922", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:15.000208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] validate_networks() for [('c7a71916-0d63-4fd1-9b48-ca6da518cd37', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:07:15.872597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:07:15.874888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:07:15.875711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:07:15.876276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:07:15.876842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:07:15.908535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:15.911457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:15.912082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:15.913095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:15.917776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:15.919451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:16.003807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for project 4eb7191b18cc41de8c9c51672246991d. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:16.014262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for user e1cbafa1d3c244c5906e475494b39d4c and project 4eb7191b18cc41de8c9c51672246991d. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:16.048781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:07:16.056290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:07:16.271889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7c74e60-3167-4f3d-b060-1ce3a68ace1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.001231 Sep 13 16:07:16.293439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 18/35] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:07:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 3023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:07:16.319183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1422342216", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:16.333034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:07:16.334014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:07:16.334833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:07:16.335495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:07:16.336063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:07:16.348841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:16.349873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:16.350463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:16.351372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:16.351972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:16.352746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:16.403624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for project 859cfa45a18845f49e525ab4ed54b529. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:16.413108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for user c0fd4bbe430b4a8888f3be4b23982c5a and project 859cfa45a18845f49e525ab4ed54b529. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:16.446111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:07:16.456176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:07:16.474006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] validate_networks() for [('89b1e5ec-b396-4707-8f39-b8104959eeb7', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:07:16.649370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-72967a4c-5537-4e0d-ba8b-826da1bf01ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.991321 Sep 13 16:07:16.655905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 18/36] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Sep 13 16:07:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:07:16.678460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:16.684212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:16.726549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:16.728884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:16.733011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:16.734309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:16.742807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:16.744848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:18.538138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:18.550785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9c4e4f1-5370-4501-a922-d9e42fbfef02 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1273 microversion: 2.1 time: 1.893437 Sep 13 16:07:18.554784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 19/37] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:16 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1273 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:18.572176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:18.588321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:18.624376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:18.624869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:18.625314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:18.626147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:18.626479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:18.626930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:18.942363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:18.952545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85421297-9569-4a74-9410-b3d97923dc97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1290 microversion: 2.1 time: 0.396338 Sep 13 16:07:18.953621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 20/38] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1290 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:18.969992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:18.969992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:19.010255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:19.011362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:19.012195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:19.016664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:19.017350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:19.017975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:19.227312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:19.250154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:19.254115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:19.255320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcfec6cc-f348-4b33-9494-a05fbaeeb7b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1278 microversion: 2.20 time: 0.300595 Sep 13 16:07:19.263028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 21/39] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:19.513608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:07:19.514013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:07:19.514425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:07:19.514832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:07:19.515469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:07:19.555375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:19.556838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:19.558529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:19.559568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:19.560266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:19.561069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:19.579910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:19.581157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:19.595297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for project 5b11b198b8754bcabf244e0047475b8d. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:19.597655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:19.598462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:19.600844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:19.601770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:19.601887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for user 6d31b2ec391441f7bab3546d2354b0a1 and project 5b11b198b8754bcabf244e0047475b8d. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:19.605014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:19.605473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:19.625247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:07:19.636342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:07:19.822142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d2ad4395-abe0-4f4a-8e2e-f49a98db0f0e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.521232 Sep 13 16:07:19.832504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 19/40] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:07:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:07:19.847006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4f5fc38-d938-4f1e-97cd-fd92e0d9f019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:19.850265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4f5fc38-d938-4f1e-97cd-fd92e0d9f019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:20.224256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4f5fc38-d938-4f1e-97cd-fd92e0d9f019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:20.231485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4f5fc38-d938-4f1e-97cd-fd92e0d9f019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1222 microversion: 2.1 time: 0.395519 Sep 13 16:07:20.249649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 20/41] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:19 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1222 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:20.265932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:20.266554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:20.278747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:20.279681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:20.280333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:20.281252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:20.281900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:20.284002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:20.845768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:20.889058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83ecc1f6-25ef-46c5-8ab9-834e2fa1b2e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1290 microversion: 2.1 time: 0.638153 Sep 13 16:07:20.895132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 21/42] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1290 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:20.929794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:20.931958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:20.942646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:20.947700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:20.949350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:20.950344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:20.954946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:20.955744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:21.066668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:21.079617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-74cbf8ce-d76f-411f-a4eb-02fe0fa1c7c9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 1.504011 Sep 13 16:07:21.081962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 22/43] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:19 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:21.172807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:21.191351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:21.196663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:21.202465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc1fcdee-d333-4b5a-b342-ba3ce4ddf090 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1278 microversion: 2.20 time: 0.305921 Sep 13 16:07:21.203859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:21.254754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:21.255138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:21.264566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:21.264982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:21.265443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:21.266133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:21.266592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:21.283870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:21.515369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:21.539151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9aae890-4fa1-4b6d-a6a7-430156e16ac3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1226 microversion: 2.1 time: 0.289193 Sep 13 16:07:21.547389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 23/45] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:21 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1226 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:21.921037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:21.921661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:21.933667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:21.945089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:21.949469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:21.950575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:21.951314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:21.953907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.109629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:22.110248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:22.123444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:22.124369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:22.124971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.125871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:22.126486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:22.127097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.198677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:22.215720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b488862-9f64-489b-b248-111c44e05b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1290 microversion: 2.1 time: 0.296531 Sep 13 16:07:22.217456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 23/46] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1290 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:22.246784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:22.247974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:22.272055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:22.272568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:22.274171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.274844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:22.275338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:22.279574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.560611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:22.594981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:22.605603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:22.611071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7fd11392-336c-492a-b00b-76848a3b6bbf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1278 microversion: 2.20 time: 0.382806 Sep 13 16:07:22.613487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 24/47] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1278 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:22.642048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:22.650781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:22.664839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:22.667680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:22.669895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.673056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:22.678121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:22.678892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:22.914008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:22.922398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8fb12352-bde1-4404-a9b0-5f5ed8c2a10e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.817237 Sep 13 16:07:22.949938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 24/48] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:22 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:22.964657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:22.976383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7f6e043-3596-4ecb-ba27-d131c77f067a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1218 microversion: 2.1 time: 0.360121 Sep 13 16:07:22.991150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 25/49] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:22 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1218 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:23.246161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:23.247483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:23.269749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:23.270267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:23.271068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:23.271804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:23.272265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:23.272703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:23.638386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:23.639246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:23.653367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:23.657762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:23.658454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:23.659381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:23.660033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:23.660645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:24.403456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:24.408090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:24.429011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c56fdd3-15a7-4f35-b449-5994d9f642ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1296 microversion: 2.1 time: 1.187228 Sep 13 16:07:24.435094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 25/50] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1296 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:24.441531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:24.445306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:24.446089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:24.449853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:24.452649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-575337ed-7b0c-4fe7-81e4-41a8af9b0159 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1334 microversion: 2.20 time: 0.818749 Sep 13 16:07:24.459958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 26/51] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1334 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:24.476780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:24.477293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:24.477784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:24.478616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:24.479930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:24.483578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:24.484033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:24.486386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:24.517025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:24.520279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:24.520777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:24.524681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:24.525167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:24.525676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:25.092422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:25.123653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58d75a22-67c8-4305-9a7c-fb1fbec73b0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1274 microversion: 2.1 time: 0.661011 Sep 13 16:07:25.130337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 27/52] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:24 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1274 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:25.462647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:25.463465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:25.483388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:25.492257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b83c06f-10f2-4154-be32-9a3ae59c9319 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 1.055859 Sep 13 16:07:25.493679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:25.494995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:25.496664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 26/53] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:24 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:25.498545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:25.499455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:25.503025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:25.503669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:25.504256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:25.509793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:25.524213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:25.524977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:25.526117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:25.533519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:25.534236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:25.534826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:25.982262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:25.996119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8a7f2fd-f2b9-44b7-aaa2-bca875032168 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1296 microversion: 2.1 time: 0.538324 Sep 13 16:07:26.006425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 28/54] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1296 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:26.153772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:26.155052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:26.169164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:26.170312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:26.171356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:26.173112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:26.174249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:26.175210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:26.249942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:26.276215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:26.281199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:26.284620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00ec25a7-a4d9-4aca-bfc2-cef601cc586f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1340 microversion: 2.20 time: 0.786678 Sep 13 16:07:26.321375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 27/55] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1340 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:26.473944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:26.483492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddea3916-7ab1-40fd-94b1-482eaa236049 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1280 microversion: 2.1 time: 0.336092 Sep 13 16:07:26.495313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 29/56] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:26 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:26.520344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:26.521219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:26.524890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:26.530011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=20 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:26.557676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:26.561569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:26.565586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:26.573284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:26.574586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:26.577633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.196686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:27.208399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-174f0587-9686-4f39-8b16-501a9e77d4b4 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.690075 Sep 13 16:07:27.211853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 28/57] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:26 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:27.243967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:27.243967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:27.259494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.266472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.266972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.267724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.268194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.276199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.502548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06c8da6-e2f3-4bef-9ed7-d3175f4d1099", "tag": "aa5a9d33-b165-4b5e-8136-0c70486538a8"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:27.541281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.543508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.544285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.605623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Creating event network-changed:aa5a9d33-b165-4b5e-8136-0c70486538a8 for instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 on hv-cinder-82002 Sep 13 16:07:27.606844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:07:27.609952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9ca1dde-5899-4b47-8486-e010f275d3a7 req-e5399473-0f8c-4a38-9bfc-3030e1cf157f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:07:27.613147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.614801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.617526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.621177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.622884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.626759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.656666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.compute.rpcapi [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 16:07:27.658090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] Releasing lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:07:27.696935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a5d6be6-bc80-40f2-a06d-3c24cf81153a None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.866308 Sep 13 16:07:27.698339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:27.707652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:27.708571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:27.725462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.726233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.726683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.727434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.727916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.728319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.901630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:27.921532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:27.923672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:27.925179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef88d6e6-6cfc-4428-a2b4-7719e4f80cc8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1340 microversion: 2.20 time: 0.225588 Sep 13 16:07:27.925917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 31/59] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1340 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:27.938762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:27.939493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:27.950238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.977542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.978168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:27.979400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:27.979924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:27.980414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:28.026807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:28.058110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b909ed5-2fbc-461e-8fb0-f441d3ebc74a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.843371 Sep 13 16:07:28.072623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 29/60] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:28.153997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:28.167711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-041eafea-a20a-4c98-960c-a99da5215cba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1280 microversion: 2.1 time: 0.240551 Sep 13 16:07:28.168627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 32/61] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:27 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:28.248892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:28.249879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:28.293849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:28.296021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:28.311849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:28.314348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:28.319792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:28.320603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:28.952944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:28.954427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:28.958335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:28.972218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:28.979896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:28.982563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:28.986090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:28.987986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:28.989876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:29.185868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:29.207800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b1a0046d-9c2c-4af5-9108-3a85290c62f0 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.963839 Sep 13 16:07:29.210743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 30/62] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:28 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:29.415160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf15226-4335-4045-96dc-a7e5fb7e72d1", "tag": "435cf4a9-bc40-4136-b685-76af6271637a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:29.433029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:29.433733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:29.434525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:29.475241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Creating event network-changed:435cf4a9-bc40-4136-b685-76af6271637a for instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 on hv-cinder-82002 Sep 13 16:07:29.476075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:07:29.482054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71de92f8-586d-4e22-95ea-a4e31954cd21 req-15eb1932-5ab3-4f51-9381-c9d8bf974d75 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:07:29.483709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:29.484506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:29.485083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:29.485994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:29.486707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:29.487856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:29.516095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.compute.rpcapi [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 16:07:29.517425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] Releasing lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:07:29.541885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba043276-784e-4b57-bd0c-9b54bbc02708 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322736 Sep 13 16:07:29.544544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 31/63] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:29.561618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:29.563510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:29.580233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:29.581889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:29.584091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:29.586852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:29.588230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:29.589222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:29.957115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:29.969137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:29.971000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:29.972563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3b431b8-ed70-46c7-aed0-329b0b679f51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 1.025859 Sep 13 16:07:29.973807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:29.979915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:29.980831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:30.006529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:30.014497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:30.015853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:30.032997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:30.033994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:30.034673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:30.231591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:30.471446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:30.478016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=93 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:30.485196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf9d52d5-50af-412f-93c9-217f1df4b7cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.937113 Sep 13 16:07:30.487324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 32/65] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:30.499685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:30.501494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:30.516138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:30.524263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:30.525083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:30.527244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:30.527982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:30.528469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:30.528901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:31.187821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:31.197910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f330682-640f-414d-bad8-edd8651db71d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 1.222329 Sep 13 16:07:31.224688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 34/66] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:29 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:31.242924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:31.244889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:31.252174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:31.252902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:31.253483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:31.254330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:31.254948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:31.255583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.058299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:32.068293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4272829a-20ca-49f1-ae83-329639340e72 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 1.578365 Sep 13 16:07:32.068857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 33/67] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:30 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:32.112958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:32.114252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:32.121237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:32.121979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:32.122577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.123471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:32.124077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:32.124654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.179492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:32.191354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:32.192809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:32.194756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f03c181d-32d8-4ab5-aa2d-d5e0e4e7871e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.963429 Sep 13 16:07:32.199218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:32.235383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:32.236848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:32.246772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:32.247649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:32.248259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.249189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:32.251098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:32.251846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.606163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:32.616153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9071622-96eb-4f76-97c4-43c887079fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.535549 Sep 13 16:07:32.624434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 34/69] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:32.638532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-b5373bf1-77c0-48e9-8380-3c2d5ebe1fe2 req-76b29891-2ec0-4307-9408-7f977d436772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8c6aa1-3270-40d0-88f2-196f26018b5c", "tag": "a5ace629-a258-4223-850a-b1429a8d3b28"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:32.676776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b5373bf1-77c0-48e9-8380-3c2d5ebe1fe2 req-76b29891-2ec0-4307-9408-7f977d436772 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:32.682541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b5373bf1-77c0-48e9-8380-3c2d5ebe1fe2 req-76b29891-2ec0-4307-9408-7f977d436772 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:32.683998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b5373bf1-77c0-48e9-8380-3c2d5ebe1fe2 req-76b29891-2ec0-4307-9408-7f977d436772 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.717848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:32.719743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-b5373bf1-77c0-48e9-8380-3c2d5ebe1fe2 req-76b29891-2ec0-4307-9408-7f977d436772 service nova] Creating event network-changed:a5ace629-a258-4223-850a-b1429a8d3b28 for instance de8c6aa1-3270-40d0-88f2-196f26018b5c on hv-cinder-82002 Sep 13 16:07:32.738985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b0b4a5d-77cf-432f-bd6d-547dcc2628bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.507622 Sep 13 16:07:32.741573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-b5373bf1-77c0-48e9-8380-3c2d5ebe1fe2 req-76b29891-2ec0-4307-9408-7f977d436772 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112307 Sep 13 16:07:32.745382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 35/70] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:32.755184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 36/71] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:32 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:32.937109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c52756ff-4c21-4288-8df3-46596bec2426 req-fe68e27a-849a-48a4-992b-9207e3154af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36aa2e1-0b94-432d-b901-f13533f560fc", "tag": "769d079d-52e4-4b48-93b1-23e2ef23bcb9"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:32.947665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c52756ff-4c21-4288-8df3-46596bec2426 req-fe68e27a-849a-48a4-992b-9207e3154af6 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:32.948154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c52756ff-4c21-4288-8df3-46596bec2426 req-fe68e27a-849a-48a4-992b-9207e3154af6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:32.948696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c52756ff-4c21-4288-8df3-46596bec2426 req-fe68e27a-849a-48a4-992b-9207e3154af6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:32.961702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c52756ff-4c21-4288-8df3-46596bec2426 req-fe68e27a-849a-48a4-992b-9207e3154af6 service nova] Creating event network-changed:769d079d-52e4-4b48-93b1-23e2ef23bcb9 for instance a36aa2e1-0b94-432d-b901-f13533f560fc on hv-cinder-82002 Sep 13 16:07:32.968266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c52756ff-4c21-4288-8df3-46596bec2426 req-fe68e27a-849a-48a4-992b-9207e3154af6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035064 Sep 13 16:07:32.969474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 36/72] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:33.110342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:33.111075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:33.117718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.118203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.119248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.119982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.120437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.120862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.125200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:33.224893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:33.225594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:33.232500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.233142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.234140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.234939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.235477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.235974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.263737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:33.271782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6919dc7b-566d-4b9d-8fef-cd89734b4b31 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.165511 Sep 13 16:07:33.272446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 37/73] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:33 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:33.420397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:33.429800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:33.432562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:33.433917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d8156ac-f9b5-4dc3-8b2e-f2e941b7c438 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.213188 Sep 13 16:07:33.434731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 37/74] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:33.644038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:33.644569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:33.652241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.652951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.653790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.654690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.655351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.655959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.771227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:33.772180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:33.780372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.782031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.782621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.783589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:33.784218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:33.785378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:33.890651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:33.898377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cb57c54-b291-413b-b3ad-5d8e1a9ad667 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.258361 Sep 13 16:07:33.899152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 38/75] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:33.957857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:33.965617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd3bc68f-33cf-401f-9305-fdec76cb82e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.199405 Sep 13 16:07:33.966204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 38/76] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:33 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:34.294799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:34.295443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:34.301476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.302717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.303289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.305530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.307147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.307736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.445502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:34.453650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8efb38c0-b48a-4148-8e42-5bd25ae46c10 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.162430 Sep 13 16:07:34.459553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:34.460157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:34.467025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.467452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.467889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.468583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.469034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.469466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.469589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 39/77] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:34 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:34.604572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:34.612694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:34.614146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:34.617806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d95e842-8a32-4ea7-8b94-bbf6d8a5779e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.159545 Sep 13 16:07:34.617806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 39/78] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:34.761204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-41cfcd11-3487-4176-8cfd-779a01cd4018 req-b2ceec60-ef6a-4f0a-8e3b-59fb2a93541b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:34.770880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-41cfcd11-3487-4176-8cfd-779a01cd4018 req-b2ceec60-ef6a-4f0a-8e3b-59fb2a93541b service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.771374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-41cfcd11-3487-4176-8cfd-779a01cd4018 req-b2ceec60-ef6a-4f0a-8e3b-59fb2a93541b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.771990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-41cfcd11-3487-4176-8cfd-779a01cd4018 req-b2ceec60-ef6a-4f0a-8e3b-59fb2a93541b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.783827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-41cfcd11-3487-4176-8cfd-779a01cd4018 req-b2ceec60-ef6a-4f0a-8e3b-59fb2a93541b service nova] Creating event network-changed:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:07:34.789000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-41cfcd11-3487-4176-8cfd-779a01cd4018 req-b2ceec60-ef6a-4f0a-8e3b-59fb2a93541b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031817 Sep 13 16:07:34.789752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 40/79] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:34.922446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:34.923187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:34.928992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.929479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.929927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.930652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:34.931680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:34.932111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:34.990411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:34.992396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:34.999942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:35.000630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:35.001068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:35.001761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:35.002360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:35.004398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:35.098347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:35.107073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad4dd109-d49d-4b93-b992-65c6a15f6518 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.188347 Sep 13 16:07:35.107890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 40/80] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:35.169180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:35.176950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be9ec7bd-61b1-46f7-ac31-5f7c810a6f3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.191579 Sep 13 16:07:35.179641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 41/81] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:34 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:35.477020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:35.478141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:35.490423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:35.491037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:35.491492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:35.492243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:35.492700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:35.493242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:35.643425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:35.643769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:35.644936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:35.652086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b6332cf-37f8-4513-bfdf-a6a71728c49a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.178807 Sep 13 16:07:35.652661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 41/82] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:35 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:35.653684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:35.654711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:35.655653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:35.657028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:35.657716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:35.658945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:35.808285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:35.820395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:35.822845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:35.824126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32bb49f9-b99f-44d3-b669-666553489689 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.185124 Sep 13 16:07:35.824909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 42/83] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:36.131441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:36.132583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:36.139968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.140589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.142191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.143038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.143689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.144235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.204558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:36.205321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:36.213826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.214519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.215609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.216718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.218571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.219375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.330073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:36.347488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78d5d1e6-8f7f-409b-a1ac-fbf33a1d9696 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.220316 Sep 13 16:07:36.362106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 42/84] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:36.422808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:36.436052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15991202-9465-4f75-8bbd-bdd4412c53e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.235464 Sep 13 16:07:36.447796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 43/85] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:36 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:36.675365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:36.675981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:36.682163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.682630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.683179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.683807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.684262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.684689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.853926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:36.855212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:36.863053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.864183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.864802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:36.867206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:36.867928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:36.869437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:37.088682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:37.097300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-467719da-2f82-4305-b963-705e40e4fbcf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.425890 Sep 13 16:07:37.098183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 43/86] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:36 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:37.195324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:37.214488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:37.216311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:37.217708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c5357e2-3211-4d50-82c1-d82c8e66ca48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.368732 Sep 13 16:07:37.218423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 44/87] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:37.376998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:37.377605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:37.383565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:37.384315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:37.384752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:37.385431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:37.385884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:37.386304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:37.461404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:37.462536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:37.472332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:37.472842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:37.473310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:37.473874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:37.474328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:37.474757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:37.531563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:37.543485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f4b4fc7-566d-4409-b2ab-6e9909448325 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.170228 Sep 13 16:07:37.544116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 44/88] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:37.650942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:37.658543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:37.664362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b6d52efd-f340-4892-b044-00788b460924 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.206761 Sep 13 16:07:37.673389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 45/89] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:37 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:38.122784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:38.123416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:38.129366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.129846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.130283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.131025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.131478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.131899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.244146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:38.244868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:38.251248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.251803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.252303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.253053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.253572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.254002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.264211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:38.272058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-04901bb0-68b9-4e4c-b298-f89aa735bd5f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.153044 Sep 13 16:07:38.272641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 45/90] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:38 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:38.380304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:38.389097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:38.390545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:38.391673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee642941-34f4-436e-ba19-8b31a0d8079a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.151949 Sep 13 16:07:38.392223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 46/91] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:38.565730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:38.566364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:38.572930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.573405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.573836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.574511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.574993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.575416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.691029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:38.691936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:38.700595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.701510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.702257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.703439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:38.704755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:38.706063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:38.713069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:38.722091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ed65b86-af7f-4a8a-ad36-71f5f0a4d15b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.160126 Sep 13 16:07:38.722660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 46/92] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:38.855926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:38.863591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aaeaf8f3-34d8-4892-88b0-5f08ca424ed2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.177920 Sep 13 16:07:38.864153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 47/93] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:38 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:39.295542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:39.296072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:39.301930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.302407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.302834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.303539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.303985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.304402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.417035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:39.417643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:39.423440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.423921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.424359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.425042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.425495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.425915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.429774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:39.437946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a44770a-19f5-421c-9832-35ef54a33846 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.146324 Sep 13 16:07:39.438511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 47/94] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:39 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:39.555017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:39.563689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:39.565127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:39.566211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b7827b6-3ae1-4bc1-90c5-e4d01bdecf3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.153801 Sep 13 16:07:39.566760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 48/95] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:39.747020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:39.747638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:39.749596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:39.758811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.759630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.760067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.760791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.761204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.761631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.888767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:39.889386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:39.900644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.901820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.902266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:39.902998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:39.903441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:39.909274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:40.389408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:40.392488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:40.397091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-196d075d-c23c-48ea-8ea7-5e04a6df57ad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.654315 Sep 13 16:07:40.397821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 48/96] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:40.400321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a2454e2-a902-48d2-bd22-1a1fb311cb0a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.517743 Sep 13 16:07:40.400877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 49/97] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:39 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:40.460724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:40.461336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:40.467318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:40.467807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:40.468245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:40.468932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:40.469386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:40.469840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:40.592397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:40.592998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:40.597297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:40.598798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:40.599309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:40.599740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:40.600422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:40.600972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:40.601553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:40.605929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-741cf725-0940-43e1-b59d-3e04be7350c6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.148879 Sep 13 16:07:40.606563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 49/98] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:40 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:40.725686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:40.733795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:40.735281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:40.736395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30bbeeeb-d609-4227-b1cd-19a4774be8a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.147869 Sep 13 16:07:40.736951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 50/99] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:41.420758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:41.421383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:41.421904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:41.422512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:41.427239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.427713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.428148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.428384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.428826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.428938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.429268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.429361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.429682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.429946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.431067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.431498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.626541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:41.628763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:41.631342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:41.636864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-013596e6-da34-4829-bb84-f07808bd51ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.220085 Sep 13 16:07:41.637438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 50/100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:41.639952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4a426dc-14b2-4932-ab4e-3d210e29c9f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.221811 Sep 13 16:07:41.640680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 51/101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:41 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:41.642182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:41.642792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:41.648482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.649677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.650346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.651104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.651622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.652058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.761880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:41.762589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:41.769194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.769194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.769766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.770468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:41.770945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:41.771380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:41.785071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:41.793766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c655edc5-9cff-45c9-babf-efeba098eca5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.155343 Sep 13 16:07:41.794579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 51/102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:41 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:41.901110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:41.909350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:41.910794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:41.911930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f67026b5-96bd-4402-8805-33202d92a257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.154860 Sep 13 16:07:41.912497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 52/103] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:42.660640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:42.661257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:42.661961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:42.662629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:42.669642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.669819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.670133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.670305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.670567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.670731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.671298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.671444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.671754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.671888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.672221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.672384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.872258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:42.875480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:42.880670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd0e01d9-0691-4cb3-b734-af4a7c3f1ef6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.224120 Sep 13 16:07:42.884093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65e7b93a-4e44-4cd6-bde6-66a3f39130c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.224879 Sep 13 16:07:42.895515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 52/104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:42.895866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 53/105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:42 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:42.900982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:42.901775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:42.907862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.908410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.908919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.909753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.910452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.910833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.943636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:42.944821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:42.963167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.963778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.964239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.965045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:42.965511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:42.965947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:42.986651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:43.168046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:43.182784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:43.185041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:43.190339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7b848f5-11e0-48f6-a64a-531cd7f020ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.253826 Sep 13 16:07:43.192883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 54/106] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:43.210860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:43.221745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b2219d4-f663-4843-b0ec-f765f2925d86 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.325130 Sep 13 16:07:43.222580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 53/107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:42 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:43.904565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:43.905485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:43.909458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:43.910100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:43.911818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:43.912300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:43.912735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:43.913424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:43.913876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:43.914299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:43.916145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:43.916618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:43.917053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:43.917727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:43.918188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:43.918596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:44.105459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:44.109147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:44.113086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebf89df6-05e3-4992-933d-6f4cd6bceb14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.212281 Sep 13 16:07:44.113657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 55/108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:44.116732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07883de3-4b1b-4cd0-b4b4-c9c52e8b4227 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.210929 Sep 13 16:07:44.117287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 54/109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:43 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:44.218716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:44.219260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:44.225152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:44.225631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:44.226066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:44.226752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:44.227354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:44.227783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:44.245978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:44.246665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:44.252492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:44.253083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:44.253522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:44.254203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:44.254652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:44.255111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:44.424408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:44.438143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:44.438884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:44.439700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:44.440988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c518b6a-9b10-4260-bc7a-2d9ee0e93fdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.226042 Sep 13 16:07:44.441576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 56/110] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:44.453357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a30833f-3c46-4d94-9596-af0091249635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.211400 Sep 13 16:07:44.454093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 55/111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:44 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:45.139610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:45.140223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:45.140328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:45.140883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:45.146135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.146616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.146710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.147086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.147199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.147557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.147781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.148232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.148320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.148664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.148769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.149092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.347681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:45.350829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:45.355924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e1126cc-cfec-447e-80b5-c3a6c0b1f64b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.219363 Sep 13 16:07:45.356495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 56/112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:45 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:45.358472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2196df8-79e1-4a93-a853-495547874c66 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.222922 Sep 13 16:07:45.359051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 57/113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:45.467069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:45.467671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:45.473676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.474149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.474580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.475348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.475744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.476162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.477052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:45.477632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:45.483573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.484117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.484492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.485180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:45.485631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:45.486057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:45.672504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:45.676515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:45.681587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:45.683082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:45.684192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6eb8568-8603-483e-9c1d-d815b8e4f5f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.220943 Sep 13 16:07:45.684750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 57/114] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:45.684941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d379d6c-37b2-4d2d-9242-4f2b34427a4c tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.211966 Sep 13 16:07:45.685672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 58/115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:45 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:46.378303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:46.378925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:46.380766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:46.381832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:46.385622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.386114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.386773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.387276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.387735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.388228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.388692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.389406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.389855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.390819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.391302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.391729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.589265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:46.592659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:46.597439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-187b14c5-ea43-4491-8160-f0c87503fbde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.223112 Sep 13 16:07:46.598012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 58/116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:46 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:46.600448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b079a42a-760a-49df-b9d2-6a7f63062c5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.223482 Sep 13 16:07:46.600995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 59/117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:46.709464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:46.709647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:46.710167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:46.710267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:46.716122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.716249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.716591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.716686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.717015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.717108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.717700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.717804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:46.718136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.718228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:46.718552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.718640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:46.914696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:46.918191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:46.922908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:46.924369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:46.925481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da7e942d-bc4b-4dcf-accd-e6530658d64b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.219792 Sep 13 16:07:46.925837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17a3ab82-5f07-4e12-afca-bccb7d0d2587 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.220109 Sep 13 16:07:46.926034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 59/118] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:46.926385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 60/119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:46 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:47.619449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:47.620054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:47.623505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:47.624112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:47.625882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.626355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.626781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.627558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.628003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.628421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.629894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.630371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.630804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.631510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.631958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.632379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.825008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:47.831967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:47.832696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cacd27ef-4f16-490f-ac53-63d584878b4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.213372 Sep 13 16:07:47.833270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 61/120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:47.839972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b035f2a5-c733-4699-aa35-921ba4c636da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.224735 Sep 13 16:07:47.840526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 60/121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:47 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:47.949860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:47.950457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:47.951311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:47.952010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:47.956309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.956779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.957201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.957795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.957919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.958274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.958377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.958701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.958806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:47.959400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:47.959852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:47.960274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:48.158857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:48.161894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:48.168338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:48.170015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:48.171312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed281fa6-1ec2-493f-8516-81040512e13c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.223835 Sep 13 16:07:48.171620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e39db7c6-8b3f-4ea8-ad6e-d2e0cddabaac tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.226327 Sep 13 16:07:48.171867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 61/122] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:48.172245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 62/123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:47 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:48.855463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:48.856154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:48.861560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:48.862097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:48.862782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:48.862892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:48.863250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:48.863941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:48.864392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:48.864814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:48.869726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:48.870223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:48.870657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:48.871591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:48.872447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:48.873028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:49.116034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:49.125637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95ca1446-b7cc-4301-b5d2-99768fe89877 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.274031 Sep 13 16:07:49.126203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 62/124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:49.141212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:49.149981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00958697-6443-45e0-90db-126005611d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.292099 Sep 13 16:07:49.150537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 63/125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:48 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:49.197408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:49.198015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:49.210073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:49.210550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:49.211802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:49.213186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:49.213963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:49.217042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:49.217593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:49.218279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:49.225827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:49.226612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:49.227405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:49.230279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:49.231066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:49.237030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:49.437582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:49.441650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:49.446878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf906a5e-558f-4173-b4f3-82d8a3505e83 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.254379 Sep 13 16:07:49.447688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 63/126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:49 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:49.459777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:49.461875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:49.463103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-625c5a19-5e5d-4be5-be3f-3388dbdafc56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.262198 Sep 13 16:07:49.463658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 64/127] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:49.512074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-5b4a263d-47e7-49b0-89ab-30f5373d0ebf req-1c760f2a-e887-4500-a588-b15360a53a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf15226-4335-4045-96dc-a7e5fb7e72d1", "name": "network-vif-plugged", "status": "completed", "tag": "435cf4a9-bc40-4136-b685-76af6271637a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:49.522549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5b4a263d-47e7-49b0-89ab-30f5373d0ebf req-1c760f2a-e887-4500-a588-b15360a53a5b service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:49.523062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5b4a263d-47e7-49b0-89ab-30f5373d0ebf req-1c760f2a-e887-4500-a588-b15360a53a5b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:49.523911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5b4a263d-47e7-49b0-89ab-30f5373d0ebf req-1c760f2a-e887-4500-a588-b15360a53a5b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:49.534941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-5b4a263d-47e7-49b0-89ab-30f5373d0ebf req-1c760f2a-e887-4500-a588-b15360a53a5b service nova] Creating event network-vif-plugged:435cf4a9-bc40-4136-b685-76af6271637a for instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 on hv-cinder-82002 Sep 13 16:07:49.540243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-5b4a263d-47e7-49b0-89ab-30f5373d0ebf req-1c760f2a-e887-4500-a588-b15360a53a5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091074 Sep 13 16:07:49.540988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 64/128] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:50.151492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:50.152098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:50.158800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.159338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.159771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.160458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.160905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.161321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.173368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:50.174068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:50.180967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.181450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.181899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.182568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.183039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.183462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.359851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:50.363917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:50.368367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1152b693-2ddd-48b8-ac12-88f6305cdbbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.221169 Sep 13 16:07:50.368948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 65/129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:50.372271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-997eee94-52f7-4e30-87b4-f6f696d4542e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.203121 Sep 13 16:07:50.373038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 65/130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:50 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:50.469698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:50.470306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:50.476729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.477212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.477646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.478327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.478778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.479230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.486576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:50.487282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:50.494142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.494619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.495092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.495761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:50.496200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:50.496613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:50.677975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:50.685852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:50.686070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ad0447f-4ed4-4e6a-95d7-66937e697635 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.220033 Sep 13 16:07:50.686635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 66/131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:50 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:50.694806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:50.696787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:50.697883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78a5df84-7371-4334-8ebb-c276157d6d86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.215137 Sep 13 16:07:50.698432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 66/132] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:51.391887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:51.392593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:51.394671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:51.395303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:51.399373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.399929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.400425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.401174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.401689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.401991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.402116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.402468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.403002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.403673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.404119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.404540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.594562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:51.598322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:51.602820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0d0ad8e-5a70-4ff2-953a-f4bd41fcc8aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.214734 Sep 13 16:07:51.603487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 67/133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:51.606255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5db47a38-f7e6-40a9-8471-cfdf427656ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.215342 Sep 13 16:07:51.607100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 67/134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:51 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:51.609432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e2d83e3d-c303-415d-9b2d-df9864bc53a9 req-4e67bad1-0fa0-4194-a88e-5287741ba6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06c8da6-e2f3-4bef-9ed7-d3175f4d1099", "name": "network-vif-plugged", "status": "completed", "tag": "aa5a9d33-b165-4b5e-8136-0c70486538a8"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:51.620448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e2d83e3d-c303-415d-9b2d-df9864bc53a9 req-4e67bad1-0fa0-4194-a88e-5287741ba6bb service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.620916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e2d83e3d-c303-415d-9b2d-df9864bc53a9 req-4e67bad1-0fa0-4194-a88e-5287741ba6bb service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.621344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e2d83e3d-c303-415d-9b2d-df9864bc53a9 req-4e67bad1-0fa0-4194-a88e-5287741ba6bb service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.633369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e2d83e3d-c303-415d-9b2d-df9864bc53a9 req-4e67bad1-0fa0-4194-a88e-5287741ba6bb service nova] Creating event network-vif-plugged:aa5a9d33-b165-4b5e-8136-0c70486538a8 for instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 on hv-cinder-82002 Sep 13 16:07:51.638777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e2d83e3d-c303-415d-9b2d-df9864bc53a9 req-4e67bad1-0fa0-4194-a88e-5287741ba6bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034205 Sep 13 16:07:51.639375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 68/135] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:51.710234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:51.711365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:51.722010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.723204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.723665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.724565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.724971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.725406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.726565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:51.727389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:51.730309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:51.734254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.734743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.735218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.735983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:51.736406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:51.736829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:51.935781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:51.943446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:51.943781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c6dabff1-56a7-499e-8ca7-8f04ad1ceda5 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.237449 Sep 13 16:07:51.944363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 68/136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:51 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:51.952152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:51.953595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:51.954689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-071ac4bd-099f-4d4c-a0aa-42e4a164d100 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.235317 Sep 13 16:07:51.955279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 69/137] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:52.626849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:52.627495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:52.628807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:52.629420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:52.634390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:52.634877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:52.635350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:52.636038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:52.636494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:52.636737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:52.636921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:52.637209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:52.637635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:52.638310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:52.638755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:52.639584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:52.833932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:52.849932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab957861-7324-4a5e-92be-cd818647e553 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.220465 Sep 13 16:07:52.849932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 70/138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:52 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:52.872413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:52.882522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a68d7a17-a002-487a-a345-0a2fb015e89f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.259446 Sep 13 16:07:52.883528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 69/139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:52.968417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:52.970482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:52.981055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:52.981888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:53.000510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.001541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.001993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.002535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.003246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.003860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.005251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.005811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.006380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.007172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.007544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.008794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.354350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:53.359698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:53.377379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e807df75-0181-4828-beee-6900d293bdb3 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.413646 Sep 13 16:07:53.377958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 71/140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:52 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:53.394643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:53.404219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:53.406581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:53.407827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83302657-d6b9-4609-904e-4fdc5aa1e703 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.432513 Sep 13 16:07:53.408561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 70/141] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:53.654739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-fc703c51-d0c1-4b50-ac3c-0ecc9260ba73 req-6d56afe2-9913-4493-88b1-7c86dc8ee7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36aa2e1-0b94-432d-b901-f13533f560fc", "name": "network-vif-plugged", "status": "completed", "tag": "769d079d-52e4-4b48-93b1-23e2ef23bcb9"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:53.667307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fc703c51-d0c1-4b50-ac3c-0ecc9260ba73 req-6d56afe2-9913-4493-88b1-7c86dc8ee7c9 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.668252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fc703c51-d0c1-4b50-ac3c-0ecc9260ba73 req-6d56afe2-9913-4493-88b1-7c86dc8ee7c9 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.668693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fc703c51-d0c1-4b50-ac3c-0ecc9260ba73 req-6d56afe2-9913-4493-88b1-7c86dc8ee7c9 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.682820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-fc703c51-d0c1-4b50-ac3c-0ecc9260ba73 req-6d56afe2-9913-4493-88b1-7c86dc8ee7c9 service nova] Creating event network-vif-plugged:769d079d-52e4-4b48-93b1-23e2ef23bcb9 for instance a36aa2e1-0b94-432d-b901-f13533f560fc on hv-cinder-82002 Sep 13 16:07:53.688308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-fc703c51-d0c1-4b50-ac3c-0ecc9260ba73 req-6d56afe2-9913-4493-88b1-7c86dc8ee7c9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037591 Sep 13 16:07:53.689067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 72/142] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:53.872517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:53.873141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:53.878943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.879436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.879926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.880565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.881352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.881817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.907023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:53.908085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:53.925518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.926159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.926643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:53.939749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:53.940242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:53.940691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:54.088897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:54.097213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-498bc23d-9390-47a9-8500-a81cdb2cb812 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.228725 Sep 13 16:07:54.098097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 71/143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:53 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:54.143150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:54.155427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b3a9127-a74f-4c90-bf5e-a57b8ee55c62 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.252338 Sep 13 16:07:54.156401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 73/144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:54.403877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:54.404802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:54.412349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:54.413176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:54.413824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:54.414586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:54.415134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:54.416065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:54.434578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:54.435830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:54.445505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:54.446069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:54.451074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:54.451813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:54.452282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:54.452717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:54.661900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:54.676583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:54.681976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:54.683637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:54.692641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1673728b-a8f5-4a32-9885-44b550c336cf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.291677 Sep 13 16:07:54.693096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 72/145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:54 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:54.693762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0794f7c4-5a97-457a-8061-5a390c646031 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.263968 Sep 13 16:07:54.701678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 74/146] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:55.123392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:55.124236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:55.134484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.135892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.136582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.138685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.140322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.144782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.182848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:55.183865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:55.195579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.196081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.196551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.198763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.199410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.200493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.373873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:55.384261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cd1b4f1-3320-4408-9967-79cae66cfdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.266308 Sep 13 16:07:55.386491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 73/147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:55 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:55.462812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:55.472979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9bf818c8-a36e-4ffe-a9d7-bde8c988d7c5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.295195 Sep 13 16:07:55.473904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 75/148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:55.716005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:55.716629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:55.720740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:55.721707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:55.722531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.723044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.723641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.724334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.724972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.726456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.729939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.730658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.731480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.732368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:55.733138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:55.733765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:55.958088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:55.969353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:55.969521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:55.971640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:55.973846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9f47acd-fc43-4c2d-b78b-3633e2899b37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.257312 Sep 13 16:07:55.974615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 76/149] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:07:55.987651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19754d5e-1192-4688-9881-4102ce9480ff tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.274118 Sep 13 16:07:56.005552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 74/150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:55 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:56.409636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:56.410736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:56.424845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:56.431600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:56.432049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:56.433110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:56.433220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:56.433642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:56.496766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:56.497536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:56.508466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:56.510607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:56.513882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:56.516572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:56.517139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:56.517753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:56.910308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:56.922348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:56.923565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f920cee7-175d-4c2e-8d61-010d89368dfc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.430977 Sep 13 16:07:56.924385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 75/151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:56.951501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c53d0e04-42ea-4812-8d34-e7505a0f3ace tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.546878 Sep 13 16:07:56.955911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 77/152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:56 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:57.003612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:57.004606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:57.012538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:57.013400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:57.040961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.041469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.041908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.042765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.044192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.045220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.045548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.045911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.046925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.048001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.049059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.049604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.290007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:57.299790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:57.302318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:57.304273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:57.305562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-deeb4111-dc95-4ed5-bb74-ca5545c020c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.305986 Sep 13 16:07:57.306602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 76/153] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:57.308454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b79fbf66-1a41-4f51-b3b9-e59f228bf0af tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.299709 Sep 13 16:07:57.309019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 78/154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:57 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:57.709568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-464732fa-c596-4354-8108-c63e3dbe85c7 req-454d1e4b-e9e0-4007-b4bb-27eaeae0a527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8c6aa1-3270-40d0-88f2-196f26018b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5ace629-a258-4223-850a-b1429a8d3b28"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:57.727956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-464732fa-c596-4354-8108-c63e3dbe85c7 req-454d1e4b-e9e0-4007-b4bb-27eaeae0a527 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.728448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-464732fa-c596-4354-8108-c63e3dbe85c7 req-454d1e4b-e9e0-4007-b4bb-27eaeae0a527 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.728879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-464732fa-c596-4354-8108-c63e3dbe85c7 req-454d1e4b-e9e0-4007-b4bb-27eaeae0a527 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.741054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-464732fa-c596-4354-8108-c63e3dbe85c7 req-454d1e4b-e9e0-4007-b4bb-27eaeae0a527 service nova] Creating event network-vif-plugged:a5ace629-a258-4223-850a-b1429a8d3b28 for instance de8c6aa1-3270-40d0-88f2-196f26018b5c on hv-cinder-82002 Sep 13 16:07:57.755496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-464732fa-c596-4354-8108-c63e3dbe85c7 req-454d1e4b-e9e0-4007-b4bb-27eaeae0a527 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049420 Sep 13 16:07:57.756092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 77/155] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:57.951585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:57.952196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:57.968857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.969346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.969783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.970492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.970955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.971378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:57.982859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:57.984022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:57.993882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:57.994722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:57.998108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:58.000429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:58.000928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:58.001372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:58.272836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:58.280263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:58.281873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-faaaf704-892a-47c0-bbcb-9e14ac1f2c41 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1322 microversion: 2.1 time: 0.304674 Sep 13 16:07:58.282761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 78/156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:57 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:07:58.289218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd40687d-34ff-4a0d-8404-34d187dfedab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.341322 Sep 13 16:07:58.289773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 79/157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:58.332725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:58.333366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:58.333468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:58.334025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:58.340054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:58.340541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:58.340974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:58.341640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:58.341744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:58.342101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:58.342432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:58.342537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:58.343057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:58.343847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:58.344380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:58.344876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:58.572796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:58.573372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:58.593287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:58.594115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1818f04e-f020-427f-84cb-6b241502967a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.261292 Sep 13 16:07:58.594982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 79/158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:58 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:58.596826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:58.598073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-942ff8e0-97d2-49a0-b61f-9791fdfeff0d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.268430 Sep 13 16:07:58.598824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 80/159] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:07:59.035361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1344076401", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:59.097793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] validate_networks() for None {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:07:59.307809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:59.309874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:59.317109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=95 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:59.319667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.320421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.320861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.321731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.322187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.322608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.388948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:07:59.389479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:07:59.390058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:07:59.390660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:07:59.391255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:07:59.401065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.401547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.401982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.402703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.403208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.403776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.422287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Getting quotas for project a19f8d067f67490cac7c827edcaaa8dc. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:07:59.424684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:07:59.427613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Getting quotas for user 96751dfa79154d3885eca3e37648c2a9 and project a19f8d067f67490cac7c827edcaaa8dc. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:07:59.440756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:07:59.444532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:07:59.497781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:59.504637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a172e6ff-a454-411c-a2d9-8e749677d43e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473035 Sep 13 16:07:59.505283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 80/160] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:07:59.511182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:59.512004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:59.515123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2da00dd-7294-48b9-ad1e-754f3c9d7b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1514 microversion: 2.1 time: 0.213442 Sep 13 16:07:59.520215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.523677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.524634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.526344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.527058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.527881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.547101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 81/161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:59 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:59.553015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad7e2898-9a9e-425f-b164-c3446ba098ab tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:59.555191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad7e2898-9a9e-425f-b164-c3446ba098ab tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:59.633784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad7e2898-9a9e-425f-b164-c3446ba098ab tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:59.641349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad7e2898-9a9e-425f-b164-c3446ba098ab tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1215 microversion: 2.1 time: 0.092971 Sep 13 16:07:59.641916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 82/162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:59 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:59.656407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:59.666245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:59.675851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.676339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.676779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.677442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.677895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.679016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.710291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:59.718063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ec0ad3f5-b25a-4338-878d-3469ceb2d882 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.211534 Sep 13 16:07:59.718627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 81/163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:59.723294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:59.724092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:59.731148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.731880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.733852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.734788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.735497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.736140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.787166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lazy-loading 'flavor' on Instance uuid a36aa2e1-0b94-432d-b901-f13533f560fc {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:07:59.920027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:07:59.941317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7cf834f-6a06-4c44-a8ef-7e62b0560bc6 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.221432 Sep 13 16:07:59.942106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-152a2191-b995-4ed5-b6c7-685d97c1d81e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc/action" status: 200 len: 32 microversion: 2.1 time: 0.298189 Sep 13 16:07:59.942261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 82/164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:59 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:07:59.942498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 83/165] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:07:59 2022] POST /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:07:59.947657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c9f6aa2b-0d69-4adc-a1fb-9cf45e5c131b req-dbfdf529-b19e-4554-8981-5e6af80fb4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "name": "network-vif-plugged", "status": "completed", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:07:59.963109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c9f6aa2b-0d69-4adc-a1fb-9cf45e5c131b req-dbfdf529-b19e-4554-8981-5e6af80fb4a1 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.963650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c9f6aa2b-0d69-4adc-a1fb-9cf45e5c131b req-dbfdf529-b19e-4554-8981-5e6af80fb4a1 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.964241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c9f6aa2b-0d69-4adc-a1fb-9cf45e5c131b req-dbfdf529-b19e-4554-8981-5e6af80fb4a1 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.965476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:59.966242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:07:59.972457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.973185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.973804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.975816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:07:59.977327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:07:59.978262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:07:59.979429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c9f6aa2b-0d69-4adc-a1fb-9cf45e5c131b req-dbfdf529-b19e-4554-8981-5e6af80fb4a1 service nova] Creating event network-vif-plugged:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:07:59.988517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c9f6aa2b-0d69-4adc-a1fb-9cf45e5c131b req-dbfdf529-b19e-4554-8981-5e6af80fb4a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044040 Sep 13 16:07:59.989125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 84/166] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:07:59.995657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:07:59.996838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:00.003489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.004153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.004742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.005593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.006195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.007947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.214387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:00.217390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:00.223939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1aae282d-75f7-4f18-b7da-6aacfeea8597 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.233521 Sep 13 16:08:00.224504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 85/167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:07:59 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:00.226196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:00.227821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:00.229117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a7218f8-d538-4090-b76d-4cbbf9db3307 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.286302 Sep 13 16:08:00.229803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 83/168] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:07:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:08:00.666570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:00.667280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:00.673731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.674335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.674822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.675670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.676193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.676852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.741683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:00.742428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:00.750925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.751694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.752284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.753168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.753626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:00.753763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.754034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.762092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82e29384-7d86-4742-964c-7edcb089aca8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1219 microversion: 2.1 time: 0.100466 Sep 13 16:08:00.763257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 86/169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:00 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:00.893180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:00.901551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3791abb0-c23b-4cac-9dc4-0ef06a7c2d0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.163875 Sep 13 16:08:00.902115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 84/170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:00.965528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:00.966131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:00.972002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.972461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.972817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:00.973490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:00.973931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:00.974346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.113011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:01.121107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7532ef0-bb8d-4c57-bbd6-468513944e89 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1315 microversion: 2.1 time: 0.159381 Sep 13 16:08:01.121672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 87/171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:00 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:01.248595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:01.249554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:01.255723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.256819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:01.257187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.257991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.258616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:01.258802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.259348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.260009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.268596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.269083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.269642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.270703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.271310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.272848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.468650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:01.473272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:01.476515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-680c7119-403a-4bc4-97ab-658095f46e00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.232652 Sep 13 16:08:01.476935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:01.477421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 85/172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:01 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:01.482835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:01.484357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:01.485546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2c1943d-e4f5-40b4-b34d-e6441e1853fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.235558 Sep 13 16:08:01.486170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 88/173] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:08:01.790093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:01.790795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:01.796788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.797259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.797691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.798431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.798825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.799267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.802031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:01.861213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:01.869737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-833b6af4-1a6b-4487-bf3e-3393acfbec46 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1211 microversion: 2.1 time: 0.084078 Sep 13 16:08:01.870486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 86/174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:01 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:01.924707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:01.925427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:01.932625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.933126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.933572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:01.934288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:01.934999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:01.935566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.095832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.104682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b74e6ae0-8e4e-47e6-b561-3d63d597b34a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.184434 Sep 13 16:08:02.105549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 89/175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:02.146476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:02.149471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:02.166403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.168552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.168995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.169734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.170146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.170567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.345370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.354577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe467e81-0c5c-4dac-a768-696e478dc196 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1501 microversion: 2.1 time: 0.213812 Sep 13 16:08:02.355445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 87/176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:02 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:02.500019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:02.500723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:02.508069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.508534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.509022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.509730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.510180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.510598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.511655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:02.512338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:02.518328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.518817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.519285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.519977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.520426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.521030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.691481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.699022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ad2cb9a-6004-48ed-bd59-bc1bec9cc2d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.203140 Sep 13 16:08:02.700109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 90/177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:02 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:02.744603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.752657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.754104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.755255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7f0d7b2-1815-4c9a-900c-29787fdf53ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.249122 Sep 13 16:08:02.755812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 88/178] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:08:02.892438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:02.893076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:02.899146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.899631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.900071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.900756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:02.901209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:02.901631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:02.960699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:02.968134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-749fbb2c-cc0a-489d-8ecd-e2b23c331993 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1267 microversion: 2.1 time: 0.079485 Sep 13 16:08:02.968678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 91/179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:02 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:03.129604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:03.130200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:03.137093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.137563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.137988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.138656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.139123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.139540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.270865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:03.278507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a2715d82-c135-40ba-a329-d48ddb05d389 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.152709 Sep 13 16:08:03.279084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 89/180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:03.722829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:03.723465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:03.730084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.730563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.731025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.731708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.732154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.732574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.782295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:03.783123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:03.789816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.790382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.791203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.792020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.792554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.793079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.898083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:03.906082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07725d14-8a77-41c9-8027-c2d1e0bf4e98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.186984 Sep 13 16:08:03.906693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 92/181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:03 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:03.941487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:03.949985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:03.951378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:03.952484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1664f85c-9ad6-41e8-a7f2-2bef78c2918c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.174435 Sep 13 16:08:03.953040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 90/182] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:08:03.990091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:03.991682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:03.997276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.997752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.998180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:03.998866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:03.999338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:03.999762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:04.063028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:04.071374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d3de0c6-ff1b-4e3a-b493-089b93d2aac8 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1267 microversion: 2.1 time: 0.085014 Sep 13 16:08:04.071939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 93/183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:03 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:04.301491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:04.302020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:04.308050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:04.308527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:04.308959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:04.309650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:04.310102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:04.310783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:04.436146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:04.443876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05f3e870-8e41-42bb-98fa-b91ef7f84089 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.146100 Sep 13 16:08:04.444541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 91/184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:04.929805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:04.930461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:04.939357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:04.939845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:04.940275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:04.940970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:04.941418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:04.941840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:04.978171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:04.978784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:04.985119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:04.985883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:04.986327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:04.987076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:04.987533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:04.987963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:05.143387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:05.154215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bc043ba-9c61-4d48-9766-18b45184e038 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.228358 Sep 13 16:08:05.164683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 94/185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:04 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:05.171019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:05.172241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:05.174015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:05.180393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:05.180878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:05.181356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:05.182050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:05.182594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:05.182835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:05.183275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:05.184309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:05.185499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b383f57-732e-4f8e-bae6-88b99bbd232f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.212273 Sep 13 16:08:05.186465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 92/186] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:08:05.274048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:05.285021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7da393ae-7bba-4147-b47d-e8465fcac617 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1267 microversion: 2.1 time: 0.129049 Sep 13 16:08:05.288987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 95/187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:05 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:05.466468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:05.467017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:05.472976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:05.473561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:05.473869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:05.475109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:05.475562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:05.476075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:05.610448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:05.618834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab2ac020-3b0a-412e-9355-1fcb03dccb44 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.156213 Sep 13 16:08:05.619447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 93/188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:06.177387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:06.178576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:06.184751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.185230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.185663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.186342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.186788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.187238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.215460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:06.217061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:06.227446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.228264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.229027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.230257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.231050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.231800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.413801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:06.423077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2265c3e3-c467-4bb0-aa3d-fc4392d591e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.249445 Sep 13 16:08:06.424106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 96/189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:06 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:06.429535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:06.430455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:06.436902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.437809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.438555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.439527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.439973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.440392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.453972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:06.472028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:06.473699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:06.475149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-430f1e0a-191d-44f1-b8de-8011daf4fc55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.266171 Sep 13 16:08:06.475937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 94/190] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:08:06.517635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:06.529646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-297069da-f5d1-435a-8755-d7f89219ded7 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1267 microversion: 2.1 time: 0.101890 Sep 13 16:08:06.529646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 97/191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:06 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:06.643326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:06.643925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:06.651844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.652334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.652770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.653462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:06.653913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:06.654336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:06.788606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:06.796941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47a2c808-151a-4069-8897-bbbf3d296854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.157486 Sep 13 16:08:06.797494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 95/192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:07.446253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:07.446919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:07.452867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.453350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.453785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.454468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.454939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.455367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.499570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:07.500197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:07.506277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.506754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.507475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.508155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.508603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.509023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.620293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:07.628138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81485a81-1a80-4630-97dd-c08c1d4ef402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.185911 Sep 13 16:08:07.628713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 98/193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:07 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:07.633992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:07.634586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:07.640234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.640720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.641154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.641843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.642293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.642714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.665110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:07.673447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:07.674990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:07.676157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d226089-518c-4a4f-9a90-225934fbc40c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.180452 Sep 13 16:08:07.676711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 96/194] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:08:07.706494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:07.714607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bcaa206b-3566-433a-a441-e1488c763135 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1267 microversion: 2.1 time: 0.084955 Sep 13 16:08:07.715203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 99/195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:07 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:07.821228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:07.821833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:07.827568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.828067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.828494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.829171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:07.829615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:07.830032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:07.958168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:07.966662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b083f0fd-3eed-4a97-9aa3-8b447972512c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.150108 Sep 13 16:08:07.967254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 97/196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:08.652299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:08.652903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:08.660060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.660541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:08.660972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:08.661656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.662689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:08.663050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:08.701022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:08.701615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:08.707609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.708089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:08.708515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:08.709413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.709862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:08.710279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:08.843748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:08.855373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-255b4f27-e2b8-44ec-a2e9-922a73e80ee0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.206890 Sep 13 16:08:08.856158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 100/197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:08 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:08.861570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:08.862248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:08.869843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.871078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:08.871672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:08.872368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.873147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:08.873397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:08.947823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:08.950125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:08.970290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:08.970610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-748e73b4-866a-4ce8-833f-f6b5bb0e3bed tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1267 microversion: 2.1 time: 0.102072 Sep 13 16:08:08.970890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:08.970998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 101/198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:08 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:08.971069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab08506e-beef-4732-8b68-681869a728bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1408 microversion: 2.20 time: 0.264189 Sep 13 16:08:08.971069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 98/199] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:08:08.991598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:08.992357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:08.999179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:08.999662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:09.000092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:09.000783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:09.001236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:09.001661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:09.058115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a58841e3-f953-4dd4-aabc-06063b2220e2"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:09.061480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:09.069118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:09.070014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:09.070599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:09.071643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:09.072389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:09.073058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:09.161151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:09.170739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04692a3f-09cb-41ac-8653-e72e56a0b391 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1363 microversion: 2.1 time: 0.184560 Sep 13 16:08:09.171580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 102/200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:09.410473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:09.435921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:09.879000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:09.879629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:09.881578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:09.887285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:09.887757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:09.888187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:09.888859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:09.889303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:09.889749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.017507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:10.025615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be8db133-6fcd-45d0-bfa0-fb2b2a1564bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.150437 Sep 13 16:08:10.026293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 103/201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:09 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:10.032676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:10.033283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:10.040802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.040927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.041338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.042031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.042484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.042927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.118790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:10.130012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec534183-9d06-4273-84be-85a58acbef05 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1285 microversion: 2.1 time: 0.102671 Sep 13 16:08:10.130721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 104/202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:10 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:10.135722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:10.136334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:10.158171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.159601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.160574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.162112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.163620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.164481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.197029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:10.693239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:10.703225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:10.705633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:10.707302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-705eeeaf-624e-4b66-9e97-92a104edfb7c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1601 microversion: 2.20 time: 0.575623 Sep 13 16:08:10.707996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 105/203] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:08:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1601 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:08:10.713463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:10.714176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:10.720228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.720709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.721302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.722277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.722941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.723370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.862610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:10.871992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-880332ee-56f7-487b-af80-4cdb93eaa022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1548 microversion: 2.1 time: 0.162504 Sep 13 16:08:10.872565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 106/204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:10.880427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:10.881071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:10.888057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.888548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.889057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:10.889756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:10.890208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:10.891924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.088849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dca529f0-ee6c-49ea-aa5e-f80249d275b0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.215169 Sep 13 16:08:11.089651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 107/205] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Sep 13 16:08:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-interface => generated 285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:08:11.104874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:11.105387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:11.118748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:11.119277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:11.122204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.122978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:11.123453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:11.123964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.184824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81c1b92e-8f78-44e8-97e9-dc629eeb9a93 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "POST /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.129402 Sep 13 16:08:11.191402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 99/206] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:08:09 2022] POST /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099/os-volume_attachments => generated 194 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:08:11.197747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:11.198576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:11.231773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:11.234460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:11.236443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.237625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:11.238072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:11.241548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.259841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96381299-59cc-4e0b-b6a3-52dd459564bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159829 Sep 13 16:08:11.260682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 108/207] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:08:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:11.265772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:11.267468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:11.280461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:11.286845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:11.287431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.288420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:11.288818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:11.289331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:11.474766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:11.518293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-781d4ad4-d7d3-47b9-b054-67f7d056b15a tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1273 microversion: 2.1 time: 0.255786 Sep 13 16:08:11.521201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 109/208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:11 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:11.850754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:11.861244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64be1a6e-4a35-4811-b2eb-30ec67dfba7b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.668380 Sep 13 16:08:11.862006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 100/209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:11 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:12.548603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:12.549562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:12.561083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:12.564806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:12.566857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:12.571040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:12.572425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:12.574000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:12.900322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:12.905020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:12.924417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:12.925702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:12.927347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:12.928773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:12.931720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:12.932364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:12.977908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:13.000819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:13.013434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e2545a6-aa51-4342-b9f4-75f2007b803e tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1273 microversion: 2.1 time: 0.472381 Sep 13 16:08:13.017952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 110/210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:12 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1273 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:13.411607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-565c6d4e-099e-42b9-8543-c8118d358c20 req-f30d1e96-a69a-4f1f-8cb5-26580bf1fd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:13.430027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:13.441095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb86757c-61a5-41fe-8d5b-70b60e122c92 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.556919 Sep 13 16:08:13.446253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 101/211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:12 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:13.447131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-565c6d4e-099e-42b9-8543-c8118d358c20 req-f30d1e96-a69a-4f1f-8cb5-26580bf1fd26 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:13.447651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-565c6d4e-099e-42b9-8543-c8118d358c20 req-f30d1e96-a69a-4f1f-8cb5-26580bf1fd26 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:13.448095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-565c6d4e-099e-42b9-8543-c8118d358c20 req-f30d1e96-a69a-4f1f-8cb5-26580bf1fd26 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:13.481908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-565c6d4e-099e-42b9-8543-c8118d358c20 req-f30d1e96-a69a-4f1f-8cb5-26580bf1fd26 service nova] Creating event network-changed:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:08:13.490730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-565c6d4e-099e-42b9-8543-c8118d358c20 req-f30d1e96-a69a-4f1f-8cb5-26580bf1fd26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087324 Sep 13 16:08:13.493205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 111/212] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:14.046171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:14.046887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:14.068351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:14.071466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:14.075601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:14.081076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:14.085967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:14.087380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:14.475049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:14.476007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:14.491216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:14.498012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:14.499908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:14.501152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:14.502255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:14.507271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:14.700565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:14.728872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a5e88c4-e909-47ec-a743-9a1c2da139b0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.684335 Sep 13 16:08:14.733462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 102/213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:14 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:14.739253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f6063567-1791-4c37-82b2-8b6d4639ec36 req-957bc14c-c79d-4725-b3ac-ccbe4a477f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8c6aa1-3270-40d0-88f2-196f26018b5c", "tag": "a5ace629-a258-4223-850a-b1429a8d3b28"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:14.791557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f6063567-1791-4c37-82b2-8b6d4639ec36 req-957bc14c-c79d-4725-b3ac-ccbe4a477f0e service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:14.793080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f6063567-1791-4c37-82b2-8b6d4639ec36 req-957bc14c-c79d-4725-b3ac-ccbe4a477f0e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:14.793579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f6063567-1791-4c37-82b2-8b6d4639ec36 req-957bc14c-c79d-4725-b3ac-ccbe4a477f0e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:14.840172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f6063567-1791-4c37-82b2-8b6d4639ec36 req-957bc14c-c79d-4725-b3ac-ccbe4a477f0e service nova] Creating event network-changed:a5ace629-a258-4223-850a-b1429a8d3b28 for instance de8c6aa1-3270-40d0-88f2-196f26018b5c on hv-cinder-82002 Sep 13 16:08:14.855001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f6063567-1791-4c37-82b2-8b6d4639ec36 req-957bc14c-c79d-4725-b3ac-ccbe4a477f0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117098 Sep 13 16:08:14.868913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 103/214] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:15.195690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:15.203853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e279ecc-114b-4dd2-983a-b995f8cd5404 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.739713 Sep 13 16:08:15.209299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 112/215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:14 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:15.765305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:15.766534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:15.781258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:15.784574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:15.785364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:15.788662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:15.796765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:15.797727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:16.217195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:16.226390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b150c13-d154-4ace-a9a7-128e9c2510b3 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.471434 Sep 13 16:08:16.239177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 104/216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:15 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:16.243685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:16.245107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:16.256969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:16.258629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:16.260158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:16.261502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:16.262947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:16.265267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:16.574689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:16.583000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10e681a2-e693-486e-8a2d-282bfbad3e8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.354758 Sep 13 16:08:16.599805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 113/217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:16 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:16.995099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-aa7a4400-df50-4280-8254-9f7b293111c7 req-993b794c-1dab-41df-b566-13fadb96a0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70471fb-853f-4ae0-bf86-22bdf7b3101d", "tag": "953f21fe-00f5-4660-ba7f-82e9c8eac39b"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:17.006210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-aa7a4400-df50-4280-8254-9f7b293111c7 req-993b794c-1dab-41df-b566-13fadb96a0ad service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:17.007174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-aa7a4400-df50-4280-8254-9f7b293111c7 req-993b794c-1dab-41df-b566-13fadb96a0ad service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:17.007748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-aa7a4400-df50-4280-8254-9f7b293111c7 req-993b794c-1dab-41df-b566-13fadb96a0ad service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:17.019518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-aa7a4400-df50-4280-8254-9f7b293111c7 req-993b794c-1dab-41df-b566-13fadb96a0ad service nova] Creating event network-changed:953f21fe-00f5-4660-ba7f-82e9c8eac39b for instance a70471fb-853f-4ae0-bf86-22bdf7b3101d on hv-cinder-82002 Sep 13 16:08:17.028742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-aa7a4400-df50-4280-8254-9f7b293111c7 req-993b794c-1dab-41df-b566-13fadb96a0ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038011 Sep 13 16:08:17.029743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 105/218] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:17.260404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:17.261555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:17.283140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:17.283140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:17.283140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:17.283140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:17.283871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:17.283871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:17.450811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:17.463706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f899b8eb-e1b9-4fa8-927b-b40c99588b07 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.209929 Sep 13 16:08:17.464558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 114/219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:17 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:17.610346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:17.611250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:17.617733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:17.618217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:17.618651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:17.619369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:17.620019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:17.620626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:17.804945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:17.812938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9c3b380-4387-428a-a040-d7b25a101290 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.207122 Sep 13 16:08:17.813636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 106/220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:17 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:18.486720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:18.487267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:18.493694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:18.494176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:18.494609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:18.495354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:18.495806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:18.496230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:18.638268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:18.646172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c16bdec-6afb-4a5a-be91-a1d667adc040 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.163241 Sep 13 16:08:18.647190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 115/221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:18 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:18.836617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:18.837306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:18.843608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:18.844086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:18.844521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:18.845378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:18.845819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:18.846301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:18.996072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:19.008256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-658f5aaa-7ab8-4162-ae3c-64ed07b07de7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.175855 Sep 13 16:08:19.009078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 107/222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:18 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:19.669420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:19.670032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:19.676046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:19.676534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:19.676972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:19.678458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:19.679123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:19.679593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:19.817602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:19.826447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4c6f69e-6d5d-4487-b3d0-ca8964862ef0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.160782 Sep 13 16:08:19.827390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 116/223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:19 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:20.033643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:20.034275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:20.041491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.041974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.042408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.043120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.043570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.043996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.556138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:20.568742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-170c9876-e444-4052-845e-17bb7a3941ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.538167 Sep 13 16:08:20.569020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:20.569407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:20.570202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 108/224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:20 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:20.575680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.576164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.576600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.577367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.577831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.578257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.609829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:08:20.716639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7ce7d3e-bb10-4dda-a40f-51913e1fd4ea tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 204 len: 0 microversion: 2.1 time: 0.153290 Sep 13 16:08:20.718080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 117/225] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:08:20 2022] DELETE /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:08:20.726205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:20.726994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:20.733087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.733568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.734002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.734690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.735181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.735631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.859458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:20.859458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:20.871206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.871714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.872160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.873085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:20.874292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:20.874736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:20.876316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:20.885593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee40c136-14e2-4b2e-aad8-7626a9334224 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1553 microversion: 2.1 time: 0.163171 Sep 13 16:08:20.886147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 109/226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:20 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:21.033580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:21.042864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f78de63d-77cc-49a9-93d8-b67c9c9a528b tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.195226 Sep 13 16:08:21.043642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 118/227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:20 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:21.323380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-091553ee-ef97-4313-9864-a020d6aad35f req-47d8c14b-6106-44d9-862c-77ef8d5e14f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70471fb-853f-4ae0-bf86-22bdf7b3101d", "name": "network-vif-plugged", "status": "completed", "tag": "953f21fe-00f5-4660-ba7f-82e9c8eac39b"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:21.336927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-091553ee-ef97-4313-9864-a020d6aad35f req-47d8c14b-6106-44d9-862c-77ef8d5e14f3 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:21.337612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-091553ee-ef97-4313-9864-a020d6aad35f req-47d8c14b-6106-44d9-862c-77ef8d5e14f3 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:21.338039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-091553ee-ef97-4313-9864-a020d6aad35f req-47d8c14b-6106-44d9-862c-77ef8d5e14f3 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:21.351014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-091553ee-ef97-4313-9864-a020d6aad35f req-47d8c14b-6106-44d9-862c-77ef8d5e14f3 service nova] Creating event network-vif-plugged:953f21fe-00f5-4660-ba7f-82e9c8eac39b for instance a70471fb-853f-4ae0-bf86-22bdf7b3101d on hv-cinder-82002 Sep 13 16:08:21.356437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-091553ee-ef97-4313-9864-a020d6aad35f req-47d8c14b-6106-44d9-862c-77ef8d5e14f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038143 Sep 13 16:08:21.357334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 110/228] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:21.593912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:21.594455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:21.601230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:21.602124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:21.602528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:21.603503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:21.604026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:21.604443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:21.762812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:21.771184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0363389-0a54-4619-8f19-00e8aefc1edc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.181278 Sep 13 16:08:21.771969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 119/229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:21 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:21.909283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:21.910022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:21.916768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:21.917255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:21.917717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:21.918403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:21.918856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:21.919327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:22.069004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:22.075879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:22.077346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2763438c-f2f8-4584-a53d-5f7948f57144 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1553 microversion: 2.1 time: 0.172192 Sep 13 16:08:22.078085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:22.084754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:22.085235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:22.085675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:22.086360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:22.087016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:22.087443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:22.091279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 111/230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:21 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:22.225893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:22.233544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43e513c6-6040-40ee-a89a-37a0bea44874 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.171028 Sep 13 16:08:22.234139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 120/231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:22 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:22.793752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:22.795176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:22.802730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:22.803486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:22.804100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:22.804966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:22.805589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:22.806069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:22.993657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:23.006781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b141443-a936-4046-9e0e-dc1d3a8c2497 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.216442 Sep 13 16:08:23.015389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 112/232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:22 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:23.102041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:23.102781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:23.108944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:23.109437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:23.109879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:23.110578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:23.111253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:23.111830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:23.267245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:23.270006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:23.289393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:23.289393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:23.291194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:23.291924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:23.292388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:23.292815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:23.405913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:23.412553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:23.439724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-490e2e85-e921-4aca-97c0-2b0a1ec2e52a tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1553 microversion: 2.1 time: 0.342166 Sep 13 16:08:23.461913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 121/233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:23 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:23.498766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:23.508252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31e6e8ef-5202-46bf-bfa0-44f7737a5e1c tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.254271 Sep 13 16:08:23.508621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 113/234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:23 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:24.034501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:24.035454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:24.045000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.045814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.046413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.047310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.048122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.049362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.259363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:24.271312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28d8d05f-9e57-47f0-8e13-755d95c7380f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.243264 Sep 13 16:08:24.271970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 122/235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:24 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:24.481414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:24.481967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:24.493210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.493983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.494420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.495167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.500269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.500747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.524038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b60b02de-6e99-4e2f-b566-6170ad3ca036 req-4086c295-3d1c-4ae8-87c4-0d7af03c4b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06c8da6-e2f3-4bef-9ed7-d3175f4d1099", "name": "network-vif-deleted", "tag": "aa5a9d33-b165-4b5e-8136-0c70486538a8"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:24.549164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b60b02de-6e99-4e2f-b566-6170ad3ca036 req-4086c295-3d1c-4ae8-87c4-0d7af03c4b94 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.549599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b60b02de-6e99-4e2f-b566-6170ad3ca036 req-4086c295-3d1c-4ae8-87c4-0d7af03c4b94 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.550039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b60b02de-6e99-4e2f-b566-6170ad3ca036 req-4086c295-3d1c-4ae8-87c4-0d7af03c4b94 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.586104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b60b02de-6e99-4e2f-b566-6170ad3ca036 req-4086c295-3d1c-4ae8-87c4-0d7af03c4b94 service nova] Creating event network-vif-deleted:aa5a9d33-b165-4b5e-8136-0c70486538a8 for instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 on hv-cinder-82002 Sep 13 16:08:24.603170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b60b02de-6e99-4e2f-b566-6170ad3ca036 req-4086c295-3d1c-4ae8-87c4-0d7af03c4b94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083210 Sep 13 16:08:24.606174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 123/236] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:24.611786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:24.612491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:24.631761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:24.644740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f72c5832-759b-4bf5-8f97-9fad105407d9 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1511 microversion: 2.1 time: 0.167224 Sep 13 16:08:24.646284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 114/237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:24 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:24.649619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.650176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.650624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.655468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:24.657789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:24.661611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:24.853732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:24.870660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-335baeb2-42c7-4502-b1e1-b05c4743cd44 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1315 microversion: 2.1 time: 0.262853 Sep 13 16:08:24.871554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 124/238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:24 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:25.296263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:25.296867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:25.304484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.306156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.306764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:25.308099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.308759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.309412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:25.530624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:25.543661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb40e92e-7de8-44ab-8a91-89ac3c01be07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.251467 Sep 13 16:08:25.544250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 115/239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:25 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:25.682937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:25.684243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:25.691268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.691966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.692549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:25.693347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.693966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.694414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:25.727294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.727777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.728463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:25.729150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lazy-loading 'fault' on Instance uuid d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:08:25.791766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:25.804064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1776cf08-c722-4d80-89f7-24b86bea73eb tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1351 microversion: 2.1 time: 0.127249 Sep 13 16:08:25.805127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 125/240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:25 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:25.897772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:25.898571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:25.907983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.908988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.909534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:25.910350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:25.911484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:25.912276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.139824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:26.150627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22d695a7-cdaa-4dae-9dca-1d2cad0be629 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1465 microversion: 2.1 time: 0.256832 Sep 13 16:08:26.151395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 116/241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:25 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:26.212408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:26.212955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:26.217435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:26.223233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.224300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.225084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.227502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.227987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.228421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.263322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:08:26.361265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-749a0bbe-3e4c-4e70-8380-cfef9257a95f tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 204 len: 0 microversion: 2.1 time: 0.152534 Sep 13 16:08:26.362029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 126/242] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:08:26 2022] DELETE /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:08:26.371759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:26.372842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:26.385126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.385628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.386075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.386781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.387349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.391760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.554551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:26.564373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bbbdc69-2a2a-43ae-969e-f092d0b1e5ca tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1471 microversion: 2.1 time: 0.197189 Sep 13 16:08:26.566959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 117/243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:26 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:26.568759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:26.569629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:26.576839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.578587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.579066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.579782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.580246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.580674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.738422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:26.750788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1695abc8-fd16-4ae8-adbf-90f6bf238394 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.186238 Sep 13 16:08:26.752131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 127/244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:26 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:26.827575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:26.828315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:26.834607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.835210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.835789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.836510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.837042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.837544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.870396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:26.871144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:26.871791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:26.872459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lazy-loading 'fault' on Instance uuid d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:08:26.920533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:26.930000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a8b242d-fe92-4890-9608-e82363a5a1a8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1351 microversion: 2.1 time: 0.106189 Sep 13 16:08:26.930573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 118/245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:26 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:27.587743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:27.588352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:27.598511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:27.599024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:27.599461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:27.600214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:27.600666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:27.601089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:27.749429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:27.758306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e556892-5083-4ff8-ba31-f4df657d52bb tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1471 microversion: 2.1 time: 0.174282 Sep 13 16:08:27.759167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 128/246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:27 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:27.781575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:27.782550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:27.789636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:27.790402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:27.790788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:27.791590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:27.792041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:27.792644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:27.954990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:27.955610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:27.965488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:27.966310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:27.967038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:27.967949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:27.970335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:27.970939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:27.978947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:27.985608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:27.999186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0382e6c4-f0b6-4aba-87b3-f295ec9047c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.222205 Sep 13 16:08:28.003445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 119/247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:27 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:28.028682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:28.029176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:28.029982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:28.030653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lazy-loading 'fault' on Instance uuid d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:08:28.121011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179e2ae27b924db0a49b64502548525a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a345ae605d56441e86b2dd45565655c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:28.129218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79984896-8ed7-4799-a6a6-291584df211f tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 200 len: 1305 microversion: 2.1 time: 0.179552 Sep 13 16:08:28.130750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 129/248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:27 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 1305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:28.782492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:28.783850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:28.792376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:28.792860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:28.794079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:28.795116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:28.795780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:28.796406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:28.818845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e535a3f4-fe43-4cbc-87ad-5fc3b9b479f9 req-b6699b16-b3ec-48c6-a7d3-dde5406bdabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70471fb-853f-4ae0-bf86-22bdf7b3101d", "name": "network-vif-deleted", "tag": "953f21fe-00f5-4660-ba7f-82e9c8eac39b"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:28.845997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e535a3f4-fe43-4cbc-87ad-5fc3b9b479f9 req-b6699b16-b3ec-48c6-a7d3-dde5406bdabf service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:28.847164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e535a3f4-fe43-4cbc-87ad-5fc3b9b479f9 req-b6699b16-b3ec-48c6-a7d3-dde5406bdabf service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:28.847681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e535a3f4-fe43-4cbc-87ad-5fc3b9b479f9 req-b6699b16-b3ec-48c6-a7d3-dde5406bdabf service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:28.883987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e535a3f4-fe43-4cbc-87ad-5fc3b9b479f9 req-b6699b16-b3ec-48c6-a7d3-dde5406bdabf service nova] Creating event network-vif-deleted:953f21fe-00f5-4660-ba7f-82e9c8eac39b for instance a70471fb-853f-4ae0-bf86-22bdf7b3101d on hv-cinder-82002 Sep 13 16:08:28.896924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e535a3f4-fe43-4cbc-87ad-5fc3b9b479f9 req-b6699b16-b3ec-48c6-a7d3-dde5406bdabf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081807 Sep 13 16:08:28.897883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 130/249] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:08:28.908648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96751dfa79154d3885eca3e37648c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19f8d067f67490cac7c827edcaaa8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:28.921189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a008db94-bdf3-41ca-b046-bcbb1f673ad0 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 200 len: 1429 microversion: 2.1 time: 0.143080 Sep 13 16:08:28.922007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 120/250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:28 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:29.029828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:29.030771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:29.059481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.061287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.061941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.072054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.072727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.073371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.153432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:29.154043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:29.159960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.160740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.161154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.162391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.162851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.163533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.184001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] HTTP exception thrown: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Request method failure captured: Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 HTTP/1.1 Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqpKH8Tk5FlF7rBKKUzFrRngC3BfK2-UrUOrVYFmTB9UFt4m_vMLaaAq1R4U7QICUIeIU-i-7JA4S--M_Xm3Wwiai9IWULY-dJvJHMspo0s_r6jf5vJH8Hw_0ed-iICEjQG7sOuG-hv4VaGbHGFkDQP53bkCscC4tuXZC_YMc7FT0g Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:08:29.188982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a345ae605d56441e86b2dd45565655c5"}]}] Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 179e2ae27b924db0a49b64502548525a Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.190491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'd06c8da6-e2f3-4bef-9ed7-d3175f4d1099'} Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:08:29.191468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.193361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.195422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Returning 404 to user: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:08:29.196447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-91d45574-a172-4844-b5e4-c08106f45ebf tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 404 len: 111 microversion: 2.1 time: 0.046799 Sep 13 16:08:29.197149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 121/251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:29 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:08:29.288730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:29.297704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18d0d44c-32b7-4f09-9fec-75ebf1747981 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.274173 Sep 13 16:08:29.298530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 131/252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:29 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:29.355512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:29.358137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:29.365018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.365511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.365950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.366648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.367136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.367562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.382825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] HTTP exception thrown: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Request method failure captured: Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099/os-volume_attachments HTTP/1.1 Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqpKH8Tk5FlF7rBKKUzFrRngC3BfK2-UrUOrVYFmTB9UFt4m_vMLaaAq1R4U7QICUIeIU-i-7JA4S--M_Xm3Wwiai9IWULY-dJvJHMspo0s_r6jf5vJH8Hw_0ed-iICEjQG7sOuG-hv4VaGbHGFkDQP53bkCscC4tuXZC_YMc7FT0g Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:08:29.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a345ae605d56441e86b2dd45565655c5"}]}] Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 179e2ae27b924db0a49b64502548525a Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.385818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'server_id': 'd06c8da6-e2f3-4bef-9ed7-d3175f4d1099'} Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:08:29.386646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:29.387895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.389129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Returning 404 to user: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:08:29.389129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e16cbf87-7a15-405f-acbc-9fe2c1c616c8 tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034587 Sep 13 16:08:29.391024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 122/253] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:08:29 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:08:29.947350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:29.947954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] [instance: a70471fb-853f-4ae0-bf86-22bdf7b3101d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:29.953716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.954189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.954612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.955340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:29.955791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:29.956266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:29.970055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] HTTP exception thrown: Instance a70471fb-853f-4ae0-bf86-22bdf7b3101d could not be found. Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Request method failure captured: Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d HTTP/1.1 Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKrdp6FtZU2mtRFiglp_073MaRnnzLRAVYl2VIS9V2fuJxsJx7y5489ZImmRnw_fLl2mMMz88HBdGo_SOaeka-UqDG8uitLqOQ7imYhbw1iuKGjiYHr2tcE55jhiJrWm7uywtON5SiS9GkgamzaDL8F7Ku-1FX6XnJsauq5SQWOIG9M Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: a19f8d067f67490cac7c827edcaaa8dc Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-526344393 Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:08:29.975637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a19f8d067f67490cac7c827edcaaa8dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a19f8d067f67490cac7c827edcaaa8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a19f8d067f67490cac7c827edcaaa8dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a19f8d067f67490cac7c827edcaaa8dc"}]}] Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-526344393 Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: a19f8d067f67490cac7c827edcaaa8dc Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-526344393 Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-526344393-project Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 96751dfa79154d3885eca3e37648c2a9 Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-526344393-project Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance a70471fb-853f-4ae0-bf86-22bdf7b3101d could not be found. Sep 13 16:08:29.977085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'a70471fb-853f-4ae0-bf86-22bdf7b3101d'} Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70471fb-853f-4ae0-bf86-22bdf7b3101d could not be found. Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:08:29.977883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70471fb-853f-4ae0-bf86-22bdf7b3101d could not be found. Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70471fb-853f-4ae0-bf86-22bdf7b3101d could not be found. Sep 13 16:08:29.979216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:29.982348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] Returning 404 to user: Instance a70471fb-853f-4ae0-bf86-22bdf7b3101d could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:08:29.982348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62458bd8-3443-4976-a5e1-e61b5475b222 tempest-VolumesNegativeTest-526344393 tempest-VolumesNegativeTest-526344393-project] 10.222.0.50 "GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d" status: 404 len: 111 microversion: 2.1 time: 0.033610 Sep 13 16:08:29.982348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 132/254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:29 2022] GET /compute/v2.1/servers/a70471fb-853f-4ae0-bf86-22bdf7b3101d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:08:30.323003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:30.323613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:30.336737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:30.338289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:30.339183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:30.340118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:30.341036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:30.341689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:30.342294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:30.509732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:30.518688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-005a0a11-d6bc-447e-a96a-beb520901e8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.199730 Sep 13 16:08:30.519914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 123/255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:30 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:30.608451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:30.609612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:30.618490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:30.619517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:30.620169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:30.620899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:30.621423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:30.621917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:30.641122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] HTTP exception thrown: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Request method failure captured: Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 HTTP/1.1 Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKqpKH8Tk5FlF7rBKKUzFrRngC3BfK2-UrUOrVYFmTB9UFt4m_vMLaaAq1R4U7QICUIeIU-i-7JA4S--M_Xm3Wwiai9IWULY-dJvJHMspo0s_r6jf5vJH8Hw_0ed-iICEjQG7sOuG-hv4VaGbHGFkDQP53bkCscC4tuXZC_YMc7FT0g Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:08:30.642959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a345ae605d56441e86b2dd45565655c5"}]}] Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 179e2ae27b924db0a49b64502548525a Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.644238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'd06c8da6-e2f3-4bef-9ed7-d3175f4d1099'} Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:08:30.645195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.646601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.649746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Returning 404 to user: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:08:30.649746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-696e0c59-127d-4c27-95f4-7faa2d8fa29e tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 404 len: 111 microversion: 2.1 time: 0.041894 Sep 13 16:08:30.649746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 133/256] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:08:30 2022] DELETE /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:08:30.654795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:30.656614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] [instance: d06c8da6-e2f3-4bef-9ed7-d3175f4d1099] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:30.667212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:30.668164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:30.668658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:30.669419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:30.669922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:30.670393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:30.689913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] HTTP exception thrown: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Request method failure captured: Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 HTTP/1.1 Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqpKH8Tk5FlF7rBKKUzFrRngC3BfK2-UrUOrVYFmTB9UFt4m_vMLaaAq1R4U7QICUIeIU-i-7JA4S--M_Xm3Wwiai9IWULY-dJvJHMspo0s_r6jf5vJH8Hw_0ed-iICEjQG7sOuG-hv4VaGbHGFkDQP53bkCscC4tuXZC_YMc7FT0g Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:08:30.693058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a345ae605d56441e86b2dd45565655c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a345ae605d56441e86b2dd45565655c5"}]}] Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: a345ae605d56441e86b2dd45565655c5 Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819572288 Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 179e2ae27b924db0a49b64502548525a Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-DeleteServersTestJSON-1819572288-project Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.694210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'd06c8da6-e2f3-4bef-9ed7-d3175f4d1099'} Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:08:30.694976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. Sep 13 16:08:30.696086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:08:30.701819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] Returning 404 to user: Instance d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:08:30.701819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-332f95af-7207-49da-ab74-44488cc7e9df tempest-DeleteServersTestJSON-1819572288 tempest-DeleteServersTestJSON-1819572288-project] 10.222.0.50 "GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099" status: 404 len: 111 microversion: 2.1 time: 0.045187 Sep 13 16:08:30.701819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 124/257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:30 2022] GET /compute/v2.1/servers/d06c8da6-e2f3-4bef-9ed7-d3175f4d1099 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:08:31.542941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:31.544356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:31.550810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:31.551624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:31.552277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:31.553184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:31.554087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:31.554726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:31.721106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:31.729123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc9e9cf9-5d6e-4b8c-9496-299451aab65f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.190284 Sep 13 16:08:31.729698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 134/258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:31 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:32.752708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:32.753550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:32.764385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:32.765489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:32.766078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:32.766960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:32.767576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:32.768145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:33.155886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:33.179299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-20a67285-be50-450f-b5a5-745aeb5a26c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.430201 Sep 13 16:08:33.180258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 125/259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:32 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:34.204577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:34.205206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:34.217289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:34.217797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:34.219069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:34.221096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:34.221751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:34.225383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:34.476019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:34.490089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd8e968d-40cf-4f0e-8324-20b3421197c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.290122 Sep 13 16:08:34.490807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 135/260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:34 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:35.514799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:35.516166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:35.529677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:35.535273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:35.535730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:35.536470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:35.538644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:35.539120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:35.835699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:35.844737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da134e4e-43d3-4215-aee0-edc77b8f138d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.334864 Sep 13 16:08:35.845303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 126/261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:35 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:36.867959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:36.868562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:36.892097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:36.893677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:36.896684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:36.898344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:36.899192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:36.902149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:37.147930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:37.165325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-192b4c6c-5301-4479-b9bc-7ceab5d6e2cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.301299 Sep 13 16:08:37.166181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 136/262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:36 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:38.191007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:38.192914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:38.204524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:38.205141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:38.205438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:38.206129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:38.207138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:38.208493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:38.405062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:38.414137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b00f80fe-89a3-43f7-9798-d0c624ceedcf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.227118 Sep 13 16:08:38.426223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 127/263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:38 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:39.439518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:39.441621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:39.456182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:39.456846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:39.457367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:39.458344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:39.458928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:39.459593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:39.682212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:39.690202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d76410d-2258-4cb7-a827-7e3e690f10ab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.254559 Sep 13 16:08:39.692090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 137/264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:39 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:40.716105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:40.717376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:40.728509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:40.729011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:40.729464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:40.730182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:40.730642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:40.731102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:40.948772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:40.970865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1f17d0b-cd68-4fd7-8452-bcf21bb020fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.258487 Sep 13 16:08:40.991869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 128/265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:40 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:42.007611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:42.008748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:42.015132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:42.015810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:42.016418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:42.017775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:42.018352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:42.019582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:42.235284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:42.242516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:42.245885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f67dd5cd-d39b-4f0a-a23e-f5750a3c5502 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1520 microversion: 2.1 time: 0.243966 Sep 13 16:08:42.247722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 138/266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:42 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:43.270146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:43.270756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:43.277597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:43.278073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:43.278502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:43.279537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:43.279993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:43.280413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:43.512556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:43.520937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f84716e8-19da-4403-a4ec-3c72d9ee09a7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1500 microversion: 2.1 time: 0.255178 Sep 13 16:08:43.535185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 129/267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:43 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1500 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:43.543310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:43.545359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:43.554119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:43.554608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:43.555630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:43.556995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:43.557676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:43.559092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:43.758607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:43.769721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd8f021b-a802-464f-a132-a3c08fbb2520 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1514 microversion: 2.1 time: 0.230058 Sep 13 16:08:43.770310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 139/268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:43 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:43.973271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5f2ed95a-c4f8-4969-b318-036bc98a35ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: .version_select at 0x7fb67c494ee0>, body: {"keypair": {"name": "tempest-keypair-1392203280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExo3qKzU3gHEzxRULbgfhWSnCpwCMLEQ06XTrRV7OH/kf5weUoz8TXQ+EHbFUmnliQpUEqVY33ZWJ0WPGjx/mlfIAyXzk4MNKkGoJoucSVArqfLnLuL9u5i0I1rkoojYg=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:43.996928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-5f2ed95a-c4f8-4969-b318-036bc98a35ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:08:44.001616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-5f2ed95a-c4f8-4969-b318-036bc98a35ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:08:44.056007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5f2ed95a-c4f8-4969-b318-036bc98a35ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274707 Sep 13 16:08:44.057165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 130/269] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:08:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:45.352136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:45.354333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:45.364014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:45.367717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:45.368611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:45.369639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:45.370579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:45.371543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:45.416676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lazy-loading 'flavor' on Instance uuid 6bf15226-4335-4045-96dc-a7e5fb7e72d1 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:08:45.536560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b55ca94-bf13-400d-848e-934095f2b450 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/action" status: 200 len: 32 microversion: 2.1 time: 0.188560 Sep 13 16:08:45.537619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 140/270] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:08:45 2022] POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:08:45.547040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:45.548240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:45.561004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:45.562009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:45.573596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:45.576913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:45.577566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:45.579555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:45.843616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-648507981", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90fe5e9a-9ff6-4724-a98f-1f72ad00105b"}], "security_groups": [{"name": "tempest-securitygroup--15345713"}], "key_name": "tempest-keypair-1392203280", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:45.886126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:45.897447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69f4aca9-69b4-4fe9-aa92-d917033e8b20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.352533 Sep 13 16:08:45.910954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 131/271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:45 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:46.046232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] validate_networks() for [('90fe5e9a-9ff6-4724-a98f-1f72ad00105b', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:08:46.640979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:08:46.641554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:08:46.641853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:08:46.642447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:08:46.643914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:08:46.654815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:46.655343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:46.655773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:46.656541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:46.656994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:46.657431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:46.682127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:08:46.687276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:08:46.709107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:08:46.716566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:08:46.832618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5da22c5f-fcf7-4e1a-b57b-7b1ea23dcd0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.995947 Sep 13 16:08:46.833284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 141/272] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:08:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:08:46.844818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a07b6a0-fb60-4c37-9ab3-c213c2fa7a87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:46.846484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a07b6a0-fb60-4c37-9ab3-c213c2fa7a87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:46.926137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:46.927037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:46.939596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:46.955161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a07b6a0-fb60-4c37-9ab3-c213c2fa7a87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:46.965563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:46.966047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:46.966832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:46.967349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:46.967780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:46.972970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a07b6a0-fb60-4c37-9ab3-c213c2fa7a87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1241 microversion: 2.1 time: 0.122169 Sep 13 16:08:46.979685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 132/273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:47.187568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:47.197274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a747a70-0337-4cee-8a8c-b238423c32ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.275554 Sep 13 16:08:47.198381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 142/274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:46 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:48.011258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:48.011915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:48.028178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:48.028303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:48.028818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:48.029530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:48.030072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:48.030599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:48.180791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:48.204794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebc3abc1-d679-4f87-9b3c-985e604d8d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1293 microversion: 2.1 time: 0.206051 Sep 13 16:08:48.210077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 133/275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:48.221508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:48.222858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:48.232414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:48.232886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:48.236248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:48.237754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:48.238227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:48.240948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:48.760110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:48.768021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad222b91-9e87-43d7-97e9-73a5bd0cb486 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.550888 Sep 13 16:08:48.771595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 143/276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:48 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:49.236263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:49.238237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:49.247495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:49.247984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:49.248504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:49.249100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:49.249544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:49.249976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:49.320972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:49.328646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37e0adbe-1e0b-44b0-a896-070553d731e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1299 microversion: 2.1 time: 0.096284 Sep 13 16:08:49.339670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 134/277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:49.794135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:49.795052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:49.805096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:49.805673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:49.806888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:49.807750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:49.808443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:49.808943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:49.971968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:49.980221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a00e66b-1207-48c9-9533-169a661a7b40 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.192235 Sep 13 16:08:49.981320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 144/278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:49 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:50.354081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:50.354936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:50.362350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:50.363235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:50.363706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:50.365159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:50.365159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:50.367367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:50.368179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-a1dd6dc3-5279-47f8-9055-cdeca57353bb req-c874305f-2925-4e2a-9e6e-9415fdb9fdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd", "tag": "8fcbe249-d838-4fbc-aa36-0e83ddfe0aab"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:50.386399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a1dd6dc3-5279-47f8-9055-cdeca57353bb req-c874305f-2925-4e2a-9e6e-9415fdb9fdf2 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:50.386870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a1dd6dc3-5279-47f8-9055-cdeca57353bb req-c874305f-2925-4e2a-9e6e-9415fdb9fdf2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:50.387321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a1dd6dc3-5279-47f8-9055-cdeca57353bb req-c874305f-2925-4e2a-9e6e-9415fdb9fdf2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:50.414040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-a1dd6dc3-5279-47f8-9055-cdeca57353bb req-c874305f-2925-4e2a-9e6e-9415fdb9fdf2 service nova] Creating event network-changed:8fcbe249-d838-4fbc-aa36-0e83ddfe0aab for instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd on hv-cinder-82002 Sep 13 16:08:50.419458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-a1dd6dc3-5279-47f8-9055-cdeca57353bb req-c874305f-2925-4e2a-9e6e-9415fdb9fdf2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054827 Sep 13 16:08:50.420439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 145/279] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:08:50.528637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:50.536640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6b9ad1a-3892-4fcc-bd6f-a2fee8a9a489 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.186742 Sep 13 16:08:50.537209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 135/280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:50.859465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1109392008", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "networks": [{"uuid": "7e5addac-2dfb-4a49-b11a-4aa634ec4ae0"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:50.917607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] validate_networks() for [('7e5addac-2dfb-4a49-b11a-4aa634ec4ae0', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:08:51.004608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:51.005133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:51.011054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:51.011540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:51.011975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:51.012663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:51.013115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:51.013540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:51.221211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:51.228842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4a51cac-0b19-41b7-98c3-e5910d9383cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.228561 Sep 13 16:08:51.229403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 136/281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:50 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:51.328788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:08:51.329233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:08:51.329707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:08:51.331255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:08:51.331682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:08:51.340517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:51.340995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:51.341425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:51.342151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:51.342601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:51.343050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:51.360124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Getting quotas for project 673d53e0757746708c6ca7b9d947b409. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:08:51.364351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Getting quotas for user 313ac02befbf44ebabf3b41f84245c1f and project 673d53e0757746708c6ca7b9d947b409. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:08:51.375153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:08:51.378268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:08:51.422721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aa605711-ee5b-4a75-9643-4ef5edeab07e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568200 Sep 13 16:08:51.423468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 146/282] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:08:51.434539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7af85fc6-a24b-4a1d-a436-14e7961a1bc9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:51.435276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7af85fc6-a24b-4a1d-a436-14e7961a1bc9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:51.490628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7af85fc6-a24b-4a1d-a436-14e7961a1bc9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:51.497414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7af85fc6-a24b-4a1d-a436-14e7961a1bc9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1219 microversion: 2.1 time: 0.066791 Sep 13 16:08:51.499051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 137/283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:51 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:51.559768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:51.561057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:51.573088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:51.573942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:51.576189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:51.577088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:51.577548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:51.577964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:51.724175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:51.733195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da2aaf7e-b3ad-47b7-acac-08d05a78b56d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.177156 Sep 13 16:08:51.734099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 147/284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:52.255569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:52.256194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:52.264527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:52.265029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:52.265628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:52.266343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:52.266796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:52.267971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:52.506429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:52.514136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a115e5f9-e434-409d-9060-2b38b6f17a31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.266304 Sep 13 16:08:52.514706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 138/285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:52 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:52.532178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:52.532772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:52.539338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:52.539814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:52.540246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:52.540927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:52.541375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:52.541799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:52.613157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:52.620526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-847ede5c-9658-4675-9ed1-ecc6aca83b89 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1271 microversion: 2.1 time: 0.092214 Sep 13 16:08:52.621089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 148/286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:52 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:52.757419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:52.758270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:52.764431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:52.765161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:52.765858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:52.766719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:52.767498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:52.768191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:53.014385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:53.027462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-33c1560a-6b9c-410f-909f-cf2a53e40c01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.274305 Sep 13 16:08:53.036839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 139/287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:53.538299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:53.538814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:53.550007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:53.550489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:53.550962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:53.551906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:53.552566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:53.553196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:53.646448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:53.647169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:53.658861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:53.659735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:53.661181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:53.663851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:53.664594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:53.665291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:53.733829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:53.746261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e34a53f2-6e4c-48c1-8709-7484ebfd2a01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.211317 Sep 13 16:08:53.759981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 149/288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:53 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:53.861370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:53.872430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cf2a350-9a5b-43ea-9428-25f859b23c2b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1319 microversion: 2.1 time: 0.231526 Sep 13 16:08:53.873721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 140/289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:53 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:54.063922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:54.063922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:54.067721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:54.069389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:54.070140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:54.081759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:54.082562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:54.083061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:54.231907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:54.241395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1bf119b1-c726-4dfa-bfad-fd4a20dbb681 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.184892 Sep 13 16:08:54.242086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 150/290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:54.770415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:54.771138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:54.780703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:54.782402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:54.783998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:54.785121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:54.786383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:54.787059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:54.836851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:54.899981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:54.901646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:54.911323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:54.912089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:54.912847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:54.915067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:54.916180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:54.917232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:55.084653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:55.092575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd65e07c-3278-4bda-975f-1035548209bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.326831 Sep 13 16:08:55.095759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 141/291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:54 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:55.115557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-71743ece-da8a-4fbf-a06a-68dffb807170 req-f8098873-f1b2-4c6a-b9d4-c0880a437e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba0d63f8-999b-48cd-beb6-455e05ee57e6", "tag": "bd46e302-1b2f-4e05-a948-3114c001bfa2"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:55.143984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71743ece-da8a-4fbf-a06a-68dffb807170 req-f8098873-f1b2-4c6a-b9d4-c0880a437e09 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:55.145368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71743ece-da8a-4fbf-a06a-68dffb807170 req-f8098873-f1b2-4c6a-b9d4-c0880a437e09 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:55.146081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-71743ece-da8a-4fbf-a06a-68dffb807170 req-f8098873-f1b2-4c6a-b9d4-c0880a437e09 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:55.169427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-71743ece-da8a-4fbf-a06a-68dffb807170 req-f8098873-f1b2-4c6a-b9d4-c0880a437e09 service nova] Creating event network-changed:bd46e302-1b2f-4e05-a948-3114c001bfa2 for instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 on hv-cinder-82002 Sep 13 16:08:55.176126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-71743ece-da8a-4fbf-a06a-68dffb807170 req-f8098873-f1b2-4c6a-b9d4-c0880a437e09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078707 Sep 13 16:08:55.177014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 142/292] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:55.177408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:55.186300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7676b13-c37f-429e-97d4-6d1c050499ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1319 microversion: 2.1 time: 0.291883 Sep 13 16:08:55.186863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 151/293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:54 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:55.268066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:55.269177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:55.275911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:55.276472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:55.277192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:55.278098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:55.278735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:55.279364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:55.447384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:55.458080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d13cdc72-5af6-4e66-82ad-59ee1a17147e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.193853 Sep 13 16:08:55.458972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 143/294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:55.569266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2f6596ff-0cba-412a-bc9b-af6a28e914d7 req-8d6cbfc3-3550-4846-856b-fc1e8e1a8dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd", "name": "network-vif-plugged", "status": "completed", "tag": "8fcbe249-d838-4fbc-aa36-0e83ddfe0aab"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:55.586416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2f6596ff-0cba-412a-bc9b-af6a28e914d7 req-8d6cbfc3-3550-4846-856b-fc1e8e1a8dd9 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:55.586889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2f6596ff-0cba-412a-bc9b-af6a28e914d7 req-8d6cbfc3-3550-4846-856b-fc1e8e1a8dd9 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:55.587674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2f6596ff-0cba-412a-bc9b-af6a28e914d7 req-8d6cbfc3-3550-4846-856b-fc1e8e1a8dd9 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:55.609461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2f6596ff-0cba-412a-bc9b-af6a28e914d7 req-8d6cbfc3-3550-4846-856b-fc1e8e1a8dd9 service nova] Creating event network-vif-plugged:8fcbe249-d838-4fbc-aa36-0e83ddfe0aab for instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd on hv-cinder-82002 Sep 13 16:08:55.621225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2f6596ff-0cba-412a-bc9b-af6a28e914d7 req-8d6cbfc3-3550-4846-856b-fc1e8e1a8dd9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061817 Sep 13 16:08:55.623399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 152/295] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:56.118031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:56.119446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:56.127820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:56.128373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:56.129261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:56.130074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:56.130588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:56.131238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:56.211724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:56.213030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:56.221830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:56.222349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:56.222959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:56.223998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:56.224754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:56.225178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:56.364626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:56.378089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9c36340-46d4-4b11-b8ae-6bdff635ba58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.263091 Sep 13 16:08:56.379501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 144/296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:56 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:56.425136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:56.433141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1964de10-c36e-401f-a7ab-8f5d04ae2dc5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1319 microversion: 2.1 time: 0.226521 Sep 13 16:08:56.446485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 153/297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:56 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:56.485466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:56.486249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:56.493579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:56.494320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:56.495047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:56.496060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:56.497087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:56.498280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:56.714047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:56.725862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-412dfb8e-1e82-4dd2-8eac-ca6fec99579c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.246910 Sep 13 16:08:56.726433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 145/298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:57.402962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:57.403567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:57.405540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:57.411387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:57.411884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:57.412327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:57.413012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:57.413648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:57.414072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:57.457439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:57.458201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:57.474180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:57.474678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:57.475142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:57.475859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:57.476313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:57.476736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:57.662882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:57.677994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d042aef7-cab5-426d-a388-171c8a4eaecc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.278857 Sep 13 16:08:57.678799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 154/299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:57 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:57.693729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:57.701827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebcb0517-cdf9-4611-bc66-44193a4f02d7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1319 microversion: 2.1 time: 0.248874 Sep 13 16:08:57.702409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 146/300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:57 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:57.749537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:57.750363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:57.756745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:57.757237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:57.757670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:57.758579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:57.759058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:57.759488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:57.899515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:57.928698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20c22f1c-0656-4c10-87cc-5025c168a002 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1365 microversion: 2.1 time: 0.182815 Sep 13 16:08:57.929706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 155/301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:58.701854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:58.702468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:58.709333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:58.710174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:58.710619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:58.711419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:58.711867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:58.712293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:58.725406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:58.726159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:58.732899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:58.735263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:58.736441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:58.737561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:58.738096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:58.738662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:58.743102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:08:58.857293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:58.866470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fc592d29-ae94-4d16-9d9a-9b99262054ff tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.168471 Sep 13 16:08:58.867228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 147/302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:58 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:08:58.953258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:58.953873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:58.960515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:58.961231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:58.961670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:58.964601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:58.965173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:58.965677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.049871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:59.057956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63a5c7fd-f30a-4f2f-a3eb-19e237006ccf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1319 microversion: 2.1 time: 0.336269 Sep 13 16:08:59.058528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 156/303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:58 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:59.244807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:08:59.253550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d0d14e3-4867-43a5-881b-5d900c5ce1e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1556 microversion: 2.1 time: 0.303967 Sep 13 16:08:59.254115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 148/304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1556 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:08:59.277869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:59.278376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:59.284389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.284872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.285316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.285996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.286446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.286871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.364239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-501773b2-7502-4e33-b53a-79ce33ef2a83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090362 Sep 13 16:08:59.364858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 157/305] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:08:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:59.544748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-01d8ad64-c625-4dfb-bdfd-95a54f0b3d61 req-b2861858-3ccc-4900-8001-7bb3091098d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0d63f8-999b-48cd-beb6-455e05ee57e6", "name": "network-vif-plugged", "status": "completed", "tag": "bd46e302-1b2f-4e05-a948-3114c001bfa2"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:08:59.555229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-01d8ad64-c625-4dfb-bdfd-95a54f0b3d61 req-b2861858-3ccc-4900-8001-7bb3091098d5 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.556291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-01d8ad64-c625-4dfb-bdfd-95a54f0b3d61 req-b2861858-3ccc-4900-8001-7bb3091098d5 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.556798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-01d8ad64-c625-4dfb-bdfd-95a54f0b3d61 req-b2861858-3ccc-4900-8001-7bb3091098d5 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.568528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-01d8ad64-c625-4dfb-bdfd-95a54f0b3d61 req-b2861858-3ccc-4900-8001-7bb3091098d5 service nova] Creating event network-vif-plugged:bd46e302-1b2f-4e05-a948-3114c001bfa2 for instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 on hv-cinder-82002 Sep 13 16:08:59.573797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-01d8ad64-c625-4dfb-bdfd-95a54f0b3d61 req-b2861858-3ccc-4900-8001-7bb3091098d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Sep 13 16:08:59.574720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 149/306] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:08:59.853200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:59.853759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:59.859613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.860107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.861287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.862421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.862920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.863365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.891416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:08:59.892460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:08:59.897838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0500715b-d8fd-4a8d-9bc3-a90f772e1523 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/ips" status: 200 len: 144 microversion: 2.1 time: 0.048841 Sep 13 16:08:59.898109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 158/307] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:08:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/ips => generated 144 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:08:59.901475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.901968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.902405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:08:59.903148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:08:59.903594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:08:59.904018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:00.082623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:00.083267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:00.089115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:00.089596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:00.090388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:00.091119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:00.091576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:00.091998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:00.158136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:00.166495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fc408c91-2412-4e96-9240-3ded06624ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.279545 Sep 13 16:09:00.167496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 150/308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:08:59 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:00.547224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:00.556885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99b545ec-94e1-4ecf-8fc7-cd054caa9aae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1319 microversion: 2.1 time: 0.479147 Sep 13 16:09:00.557628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 159/309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:00 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:00.778770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-d818b38b-dd72-4dae-b282-4a64dcca4a3d req-d7195a1e-54ef-462d-9add-1063b75a4943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd", "tag": "8fcbe249-d838-4fbc-aa36-0e83ddfe0aab"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:00.785867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:00.796232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d818b38b-dd72-4dae-b282-4a64dcca4a3d req-d7195a1e-54ef-462d-9add-1063b75a4943 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:00.796641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d818b38b-dd72-4dae-b282-4a64dcca4a3d req-d7195a1e-54ef-462d-9add-1063b75a4943 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:00.797084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d818b38b-dd72-4dae-b282-4a64dcca4a3d req-d7195a1e-54ef-462d-9add-1063b75a4943 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:00.810943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-d818b38b-dd72-4dae-b282-4a64dcca4a3d req-d7195a1e-54ef-462d-9add-1063b75a4943 service nova] Creating event network-changed:8fcbe249-d838-4fbc-aa36-0e83ddfe0aab for instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd on hv-cinder-82002 Sep 13 16:09:00.816878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-d818b38b-dd72-4dae-b282-4a64dcca4a3d req-d7195a1e-54ef-462d-9add-1063b75a4943 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042113 Sep 13 16:09:00.817491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 151/310] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:01.183669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:01.184235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:01.191221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:01.192105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:01.192609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:01.193410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:01.193942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:01.194137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:01.194567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:01.194827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:01.201919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:01.202338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:01.202761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:01.203521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:01.204611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:01.205259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:01.220948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a52aea88-a659-4c5b-97af-4f4a4ca04816 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/ips" status: 200 len: 153 microversion: 2.20 time: 0.041323 Sep 13 16:09:01.221765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 160/311] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Sep 13 16:09:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:09:01.376931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:01.385505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d362d20b-7b1b-4b3f-9992-d5ca14f26e36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.195773 Sep 13 16:09:01.387479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 152/312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:01 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:01.585807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:01.586510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:01.603122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:01.603836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=12 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:01.607142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:01.611516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:01.612173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:01.612904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:01.615439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:01.616107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:01.817087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:01.825566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a9d2420-08a5-498b-a53f-9ba2757d0c53 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1507 microversion: 2.1 time: 0.244387 Sep 13 16:09:01.839526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 161/313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:01 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:02.409914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:02.410448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:02.412453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:02.418232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:02.418716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:02.419177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:02.419865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:02.420316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:02.420741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:02.554829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:02.562683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2e5ab25-0612-4d7e-8c0c-f6d6b4cc3dfd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.156915 Sep 13 16:09:02.563861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 153/314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:02 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:03.586369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:03.587682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:03.593798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:03.594286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:03.594724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:03.595590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:03.596205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:03.596205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:03.726656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:03.734669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e806221e-e283-424a-aef7-72caa160e33e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.152291 Sep 13 16:09:03.735267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 162/315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:03 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:04.138442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe9dd007-30cc-4611-96e4-63abde6e68a7"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:04.141848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:04.148993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:04.149475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:04.149907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:04.150599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:04.151084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:04.151505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:04.168003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:04.168538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:04.175180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:04.175669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:04.176106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:04.176797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:04.177250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:04.177710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:04.206455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lazy-loading 'flavor' on Instance uuid 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:09:06.876150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3d2ce13-925b-4f4a-aec6-d5ce7e911679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.741405 Sep 13 16:09:06.878084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 154/316] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:09:04 2022] POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 194 bytes in 2744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:06.893409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:06.894597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:06.905247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:06.906063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:06.906683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:06.907639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:06.909006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:06.909532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:07.053618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:07.061788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9ae95fe-0aa2-41b5-aa6d-77e1cdabcae6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.181587 Sep 13 16:09:07.062354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 155/317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:06 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:08.085146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:08.085822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:08.097732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.098514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.099191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.100183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.100836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.101515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.234768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:08.243628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-29a5c754-0680-42e9-bf8e-0934cf0dad48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1500 microversion: 2.1 time: 0.162441 Sep 13 16:09:08.244189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 156/318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:08 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1500 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:08.267814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5796977-821d-44d0-b3ef-36c39a93fcc3"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:08.270006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:08.275808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.276283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.276715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.277389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.277835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.278255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.300895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] HTTP exception thrown: Cannot 'attach_volume' instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 while it is in vm_state rescued Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Request method failure captured: Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/os-volume_attachments HTTP/1.1 Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 74 Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKquW9FPzA91u_gO_OM_eeWoJaatE8b1iQ9x6o0TlAVBkMLDN6sWT_dRsTvpAp68FOuTvOEzmkhGiaaEqsBPwk_NbYkfBtEhI6xZRktvSgflCo6rs1tuTtY9mKEZ7t464omn-EQ-AK4F3_bvEXAA2Ba179oSmmRIlA2FeEZGmMqMbDo Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:09:08.302793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b11b198b8754bcabf244e0047475b8d"}]}] Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 6d31b2ec391441f7bab3546d2354b0a1 Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {"volumeAttachment": {"volumeId": "f5796977-821d-44d0-b3ef-36c39a93fcc3"}} Sep 13 16:09:08.304596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Cannot 'attach_volume' instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 while it is in vm_state rescued Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '6bf15226-4335-4045-96dc-a7e5fb7e72d1', 'body': {'volumeAttachment': {'volumeId': 'f5796977-821d-44d0-b3ef-36c39a93fcc3'}}} Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:09:08.305409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 while it is in vm_state rescued Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:09:08.306744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 while it is in vm_state rescued Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Returning 409 to user: Cannot 'attach_volume' instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 while it is in vm_state rescued {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5cd7229-5fa2-42ea-a71f-4ec6840e1557 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040668 Sep 13 16:09:08.308087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 157/319] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:09:08 2022] POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:09:08.313896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:08.315191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:08.321616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.322128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.322560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.323284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.323733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.324154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.360403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:08.393748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f435441e-6f8b-4393-9696-cc97f72e912e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/action" status: 202 len: 0 microversion: 2.1 time: 0.084072 Sep 13 16:09:08.394366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 158/320] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:09:08 2022] POST /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:09:08.402715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:08.403494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:08.412838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.413322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.413754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.414439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:08.414890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:08.415348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:08.560664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:08.569882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3dce1969-7823-41f3-9f1b-f3add8143231 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1508 microversion: 2.1 time: 0.171006 Sep 13 16:09:08.570563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 159/321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:08 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:09.595245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:09.595884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:09.604293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:09.604786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:09.605232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:09.605945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:09.606401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:09.606833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:09.739550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:09.750691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-800c48fc-3f93-4f60-b98d-c39f140a4c58 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1508 microversion: 2.1 time: 0.159860 Sep 13 16:09:09.751412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 160/322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:09 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:10.774501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:10.775151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:10.782141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:10.782759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:10.783468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:10.784396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:10.785110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:10.785704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:10.929872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:10.937493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69adc31f-b7a4-4806-b74b-1c9de7c24704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1508 microversion: 2.1 time: 0.166804 Sep 13 16:09:10.938052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 161/323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:10 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:11.960865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:11.961507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:11.967981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:11.968458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:11.968894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:11.969580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:11.970029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:11.970444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:12.102615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:12.110357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1addf2aa-6090-4c84-93ea-d6ef7a95b7f9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1514 microversion: 2.1 time: 0.153359 Sep 13 16:09:12.110921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 162/324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:11 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:13.473320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cedcda78-49fa-4512-849b-6ffcdbf32aa3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'create', calling method: .version_select at 0x7fb67c45f1f0>, body: {"keypair": {"name": "tempest-keypair-1227990365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxajLe0lCE/Sq6p8qi2zkyiIS/g57F5/4mbxtOFXjJqGsZS52y/wsbhelHS5QtLgm0EZ19epurjFuQZmZk0yddhz+/1VQvyvQJtHo9X+tWRJ3cbzICSM5lpgso2s0aPzg=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:13.489725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-cedcda78-49fa-4512-849b-6ffcdbf32aa3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for project 5b11b198b8754bcabf244e0047475b8d. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:09:13.493785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-cedcda78-49fa-4512-849b-6ffcdbf32aa3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for user 6d31b2ec391441f7bab3546d2354b0a1 and project 5b11b198b8754bcabf244e0047475b8d. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:09:13.524672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cedcda78-49fa-4512-849b-6ffcdbf32aa3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055561 Sep 13 16:09:13.525230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 163/325] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:09:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:09:14.172169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=19 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:14.282492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:14.402420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b9ae954-fa95-4b9c-9fee-e3074800e2aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/action" status: 202 len: 0 microversion: 2.20 time: 10.237612 Sep 13 16:09:14.408218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 163/326] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Sep 13 16:09:04 2022] POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/action => generated 0 bytes in 10245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:09:14.417008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:14.417726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:14.429009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:14.430134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:14.430638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:14.431751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:14.432195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:14.433095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:14.598852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:14.614469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:14.617691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:14.619207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2860acb-14d9-4b1b-a478-d3b01af67212 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.210180 Sep 13 16:09:14.620275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 164/327] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:14.991999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-787164655", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89b1e5ec-b396-4707-8f39-b8104959eeb7"}], "security_groups": [{"name": "tempest-securitygroup--624380804"}], "key_name": "tempest-keypair-1227990365", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:15.111686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] validate_networks() for [('89b1e5ec-b396-4707-8f39-b8104959eeb7', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:09:15.511944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:09:15.512543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:09:15.512821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:09:15.513399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:09:15.513879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:09:15.523044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.523519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.524147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.525014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.525535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.525966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.546814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for project 5b11b198b8754bcabf244e0047475b8d. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:09:15.551862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Getting quotas for user 6d31b2ec391441f7bab3546d2354b0a1 and project 5b11b198b8754bcabf244e0047475b8d. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:09:15.560562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85ed0c04-d52c-43f9-8442-78c63bc487aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:15.563378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:09:15.565858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:09:15.567605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ed0c04-d52c-43f9-8442-78c63bc487aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.568095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ed0c04-d52c-43f9-8442-78c63bc487aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.568531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ed0c04-d52c-43f9-8442-78c63bc487aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.615962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0049c9e5-6a83-4aef-b488-32585aa45fa8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.629679 Sep 13 16:09:15.617123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 164/328] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:09:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:09:15.630085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76f56294-5a2b-4b11-bc32-743825756fe0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:15.630977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76f56294-5a2b-4b11-bc32-743825756fe0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:15.631247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85ed0c04-d52c-43f9-8442-78c63bc487aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Going to try to stop instance {{(pid=120638) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:09:15.693880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85ed0c04-d52c-43f9-8442-78c63bc487aa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.136576 Sep 13 16:09:15.701284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 165/329] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:09:15 2022] POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:09:15.711387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:15.712402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:15.721940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.723461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.724131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.725075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.725956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.726754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76f56294-5a2b-4b11-bc32-743825756fe0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:15.727198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.737560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76f56294-5a2b-4b11-bc32-743825756fe0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1245 microversion: 2.1 time: 0.112562 Sep 13 16:09:15.738681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 165/330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:15.753557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:15.754869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:15.761931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.762487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.763162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.764051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:15.764505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:15.764925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:15.971135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:15.975381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:15.976898 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:15.978109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-564b61f3-77fa-413f-9c98-59d42952f746 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.274476 Sep 13 16:09:15.978740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 166/331] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:15.992391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:16.001609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ff47ae7-e293-4dc0-a24d-2bde2e48bc3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.257243 Sep 13 16:09:16.002992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 166/332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:16.761426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:16.762068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:16.770281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:16.770281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:16.770281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:16.770654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:16.771145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:16.771579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:16.838509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:16.846203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fad867d7-50f5-4903-91ca-f8112ecd3b02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1297 microversion: 2.1 time: 0.089241 Sep 13 16:09:16.846759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 167/333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:17.004555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:17.006546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:17.014009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:17.015015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:17.023545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:17.024797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:17.025481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:17.026134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:17.028042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:17.028748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:17.035061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:17.036598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:17.037186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:17.037896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:17.038354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:17.038967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:17.286314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:17.289970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:17.296087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76e9b7be-e271-447b-affa-da91d37289b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.271809 Sep 13 16:09:17.296653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 168/334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:17.299513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:17.301703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:17.303191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62cbd336-88fe-43f3-83b8-e53759e70598 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.304424 Sep 13 16:09:17.303893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 167/335] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:17.869967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:17.871437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:17.879607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:17.880193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:17.880718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:17.881497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:17.882027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:17.882676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:18.027292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:18.035849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66d95d6d-2ac3-409a-bf41-04d763e12ad9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.169336 Sep 13 16:09:18.036853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 169/336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:18.321496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:18.322256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:18.328082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:18.328564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:18.329114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:18.329785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:18.330096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:18.330702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:18.330820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:18.331633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:18.338600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:18.339222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:18.339942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:18.340731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:18.341259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:18.341772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:18.545113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:18.547557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:18.558126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:18.558581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35791f05-4cc6-463f-a784-d92aee3c3109 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.241433 Sep 13 16:09:18.559619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:18.560127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 168/337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:18.574575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edd7ac6b-1edb-4ebb-9833-bd763064ffbc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.235509 Sep 13 16:09:18.574575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 170/338] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:18.574953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-68701d20-697c-4280-95d5-5d42f516afa0 req-7ca071e6-1b21-4da3-a240-a2741579bd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:18.590072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-68701d20-697c-4280-95d5-5d42f516afa0 req-7ca071e6-1b21-4da3-a240-a2741579bd79 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:18.590670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-68701d20-697c-4280-95d5-5d42f516afa0 req-7ca071e6-1b21-4da3-a240-a2741579bd79 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:18.591298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-68701d20-697c-4280-95d5-5d42f516afa0 req-7ca071e6-1b21-4da3-a240-a2741579bd79 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:18.605914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-68701d20-697c-4280-95d5-5d42f516afa0 req-7ca071e6-1b21-4da3-a240-a2741579bd79 service nova] Creating event network-changed:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:09:18.610669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-68701d20-697c-4280-95d5-5d42f516afa0 req-7ca071e6-1b21-4da3-a240-a2741579bd79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Sep 13 16:09:18.611536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 171/339] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:19.059663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:19.060377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:19.070103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:19.070998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:19.072276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:19.073526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:19.074391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:19.074833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:19.240123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:19.247730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc043261-042c-4537-8176-896c691b4a61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.192380 Sep 13 16:09:19.248294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 169/340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:19.590584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:19.591315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:19.593507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:19.594203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:19.599200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:19.599801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:19.603196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:19.603417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:19.603977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:19.604112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:19.604444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:19.604709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:19.604870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:19.605575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:19.606464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:19.607164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:19.802438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:19.811027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c389951d-1b55-4719-adb0-42de0d557d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.224732 Sep 13 16:09:19.814934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 172/341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:19.815093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:19.825163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:19.826853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:19.828040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ef6c63e-2020-4681-a521-7ca233cb3257 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.239456 Sep 13 16:09:19.828591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 170/342] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:20.272885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:20.273482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:20.279312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:20.279785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:20.280218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:20.280891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:20.281337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:20.281755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:20.418552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:20.426280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c6cc0c7-62d3-4958-b10a-0cfd99d72f15 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.157993 Sep 13 16:09:20.427191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 173/343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:20.834722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:20.835339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:20.841257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:20.841739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:20.842174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:20.842856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:20.843330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:20.843754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:20.853539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:20.854227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:20.860616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:20.861093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:20.861527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:20.862207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:20.862651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:20.863634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:21.041640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:21.050402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da8164e5-ec38-4f89-88d0-4415e6ca8a37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.219568 Sep 13 16:09:21.051644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 171/344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:21.056844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:21.065287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:21.066803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:21.068191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f0b6f6a-1f74-4ba8-942f-10ba76b0818f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.218534 Sep 13 16:09:21.068764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 174/345] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:21.449584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:21.450186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:21.456485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:21.457526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:21.458067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:21.458758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:21.459246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:21.459671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:21.597810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:21.606166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e04a837-1f69-4552-b842-01afed7be66a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.160425 Sep 13 16:09:21.606867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 172/346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:22.075023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:22.075632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:22.082795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:22.083297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:22.083733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:22.084419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:22.084873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:22.085303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:22.093031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:22.093691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:22.100014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:22.100168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:22.100498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:22.100930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:22.101620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:22.102063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:22.102492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:22.302404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:22.305719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:22.312070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-023a7e4f-2ad9-4574-abf4-752e1bb0b87a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.240943 Sep 13 16:09:22.312889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 175/347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:22.325433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:22.327102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:22.328440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27093a09-569d-49d0-bbd0-8bdd8cc162e7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.239286 Sep 13 16:09:22.328988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 173/348] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:22.630215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:22.630813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:22.636701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:22.637173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:22.637601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:22.638280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:22.638725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:22.639305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:22.765729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:22.773780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6bd131a3-0bbe-4cc6-9b75-a0d63b142b27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.148112 Sep 13 16:09:22.774345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 176/349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:23.336293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:23.336904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:23.342767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:23.343281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:23.343716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:23.344396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:23.344896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:23.345318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:23.353457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:23.354069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:23.360890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:23.361637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:23.361778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:23.362588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:23.363244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:23.363675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:23.500171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:23.552454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:23.559530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-09300e56-e639-4ad2-ba3c-311ca298c4df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.227444 Sep 13 16:09:23.560183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 174/350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:23.561071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:23.569667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:23.571137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:23.572276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f680b60e-a8ea-45ba-a030-e2cb41d5514e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.222739 Sep 13 16:09:23.572821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 177/351] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:23.797008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:23.797561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:23.804420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:23.804898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:23.805337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:23.806016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:23.806468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:23.806892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:23.937961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:23.946184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84065c5b-a34b-46c5-96f7-ab2641dad17f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.153150 Sep 13 16:09:23.946738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 175/352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:24.583382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:24.584040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:24.590374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:24.590855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:24.592826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:24.593537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:24.594004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:24.594431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:24.600133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:24.600133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:24.605833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:24.606320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:24.606758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:24.607497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:24.607950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:24.608684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:24.794331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:24.801479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:24.803523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-067064b3-cc03-4d64-9261-046c17c779b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.224471 Sep 13 16:09:24.804103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 178/353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:24.810926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:24.811755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:24.813073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55d2994e-86d3-4434-bcc2-1fbadc8bb1d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.219394 Sep 13 16:09:24.814851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 176/354] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:24.969402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:24.969928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:24.975999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:24.977357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:24.977878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:24.979111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:24.979923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:24.980596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:25.113545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:25.121294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-97c1842c-17bd-4283-a300-8b0c392edff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.156025 Sep 13 16:09:25.121848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 179/355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:25.830358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:25.830975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:25.833104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:25.833990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:25.839040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:25.839793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:25.839918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:25.840286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:25.840712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:25.841406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:25.841840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:25.842257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:25.846093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:25.846573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:25.847613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:25.848303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:25.848745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:25.849170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:26.039339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:26.042791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:26.047932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cac8f473-af60-48bc-be99-fde80969bd77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.221360 Sep 13 16:09:26.048865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 177/356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:26.051762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:26.053412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:26.054610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b663b28f-af29-439d-a7b5-8980771b994c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.220127 Sep 13 16:09:26.055508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 180/357] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:26.145397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:26.146103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:26.151950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:26.152500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:26.152999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:26.153746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:26.154201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:26.154627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:26.287006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:26.294622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd81630b-a76d-4bbd-9a47-ec26a678531f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.153763 Sep 13 16:09:26.295216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 178/358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:27.077104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:27.077685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:27.081648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:27.082255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:27.085170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.085658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.086097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.086875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.087351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.087777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.088242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.088718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.089149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.089862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.090311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.090732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.286041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:27.288412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:27.294585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4abfeae-b742-4da7-ba91-dd236b0b94c6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.222179 Sep 13 16:09:27.300773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 181/359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:27.300934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:27.300934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:27.300934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65e04204-d9c1-42df-995b-429ffd121654 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.221783 Sep 13 16:09:27.301221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 179/360] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:27.323888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:27.324439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:27.330276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.330750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.331854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.332775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.333227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.333648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.474927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:27.482441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-99550a99-6380-4a9b-8e43-eaa66b2f43db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.162319 Sep 13 16:09:27.483042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 182/361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:27.703152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-3494937d-b48b-49b8-a2e1-a1af18e9e473 req-f293516f-2109-4a8e-a145-24d18b7bd4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "name": "network-vif-plugged", "status": "completed", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:27.713311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3494937d-b48b-49b8-a2e1-a1af18e9e473 req-f293516f-2109-4a8e-a145-24d18b7bd4fa service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:27.713774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3494937d-b48b-49b8-a2e1-a1af18e9e473 req-f293516f-2109-4a8e-a145-24d18b7bd4fa service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:27.714199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3494937d-b48b-49b8-a2e1-a1af18e9e473 req-f293516f-2109-4a8e-a145-24d18b7bd4fa service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:27.726916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-3494937d-b48b-49b8-a2e1-a1af18e9e473 req-f293516f-2109-4a8e-a145-24d18b7bd4fa service nova] Creating event network-vif-plugged:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:09:27.731926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-3494937d-b48b-49b8-a2e1-a1af18e9e473 req-f293516f-2109-4a8e-a145-24d18b7bd4fa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Sep 13 16:09:27.732574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 180/362] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:28.322240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:28.322888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:28.325957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:28.326672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:28.329955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.330439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.330872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.331588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.332039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.332471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.333176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.333661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.334107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.334798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.335287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.335716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.528403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:28.532238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:28.537252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9eaa253-f2eb-41f7-868e-8dd4d6acddff tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.218844 Sep 13 16:09:28.537829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 183/363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:28.541043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:28.542478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:28.542603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:28.543128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:28.544228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27886826-bc47-49d2-89be-084e4e8c8efb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.222538 Sep 13 16:09:28.547664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 181/364] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:28.549069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.549566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.550785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.551710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.552169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.552599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.686971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:28.694652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f4633aa-9aff-4a2f-8bee-3edaa8146d45 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.155809 Sep 13 16:09:28.695192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 184/365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:28.860623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c73ace70-d10d-459e-b09f-6acec9948094", "device": "/dev/sdb"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:28.864425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:28.870669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.871269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.871764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.872730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:28.873180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:28.873631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:28.967311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:29.240737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-358cbf8f-5bcd-49a5-9a7f-ecb238d4d15c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "POST /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383929 Sep 13 16:09:29.241451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 182/366] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:09:28 2022] POST /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:29.561711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:29.562326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:29.570562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:29.574549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:29.575030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:29.575915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:29.576530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:29.576676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:29.577593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:29.578128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:29.590799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:29.591504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:29.592154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:29.592951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:29.593473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:29.593974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:29.776257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:29.790746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a9579c8-ada8-48f5-9633-18d6f3742193 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.232398 Sep 13 16:09:29.791723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 185/367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:29.797017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:29.797820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:29.804649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:29.805154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:29.805595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:29.806309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:29.806767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:29.807226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:29.812482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:29.821534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:29.823214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:29.824590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2301debd-80c1-4478-9cb6-d52ad5a89432 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1726 microversion: 2.20 time: 0.254999 Sep 13 16:09:29.825438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 183/368] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:29.950065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:29.958053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b2f2f6d-dceb-4db3-862a-ea07c723a219 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1370 microversion: 2.1 time: 0.164671 Sep 13 16:09:29.958696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 186/369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:30.825388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:30.825990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:30.832469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:30.832950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:30.833380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:30.834058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:30.834506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:30.834948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:30.850274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:30.850996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:30.853343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:30.858855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:30.859387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:30.859818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:30.860517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:30.860966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:30.861388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:31.028073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:31.036245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1db4bd39-d2ff-4ec5-a6bf-65d799b6af28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.214692 Sep 13 16:09:31.036808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 184/370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:31.041323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:31.041933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:31.047796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:31.048283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:31.048910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:31.049614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:31.050073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:31.050507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:31.057052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:31.065963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:31.067494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:31.068852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7577c174-e4e4-4848-905d-1caab6625b22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1747 microversion: 2.20 time: 0.222479 Sep 13 16:09:31.069409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 187/371] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1747 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:31.189077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:31.196713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63c814cb-c2d5-445a-8c84-833ff8bb21f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1562 microversion: 2.1 time: 0.158976 Sep 13 16:09:31.197267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 185/372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:31.219568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:31.220061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:31.226462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:31.226960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:31.227392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:31.228065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:31.228514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:31.228931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:31.306846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08a21849-0d90-49f5-b8c4-6b3eaf590f66 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091046 Sep 13 16:09:31.307471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 188/373] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:09:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:32.074136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:32.074838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:32.083875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:32.085645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:32.087061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:32.090706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:32.091704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:32.092411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:32.096040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:32.096811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:32.105936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:32.106476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:32.109645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:32.110615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:32.111147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:32.115605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:32.433497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:32.440957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:32.443938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62904095-6017-41a7-8fcd-dac5a6f0a4f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.386769 Sep 13 16:09:32.444713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 186/374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:32.464519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:32.466096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:32.467293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be9232a3-2ae1-4fdf-aef2-7507fd22cbd9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1747 microversion: 2.20 time: 0.376151 Sep 13 16:09:32.471202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 189/375] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1747 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:32.715904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-137fd5a5-8570-4a93-8798-33a1eb9e9e84 req-e2d67a84-f875-4dae-96b1-67413d6e4f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:32.726605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-137fd5a5-8570-4a93-8798-33a1eb9e9e84 req-e2d67a84-f875-4dae-96b1-67413d6e4f69 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:32.727273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-137fd5a5-8570-4a93-8798-33a1eb9e9e84 req-e2d67a84-f875-4dae-96b1-67413d6e4f69 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:32.727848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-137fd5a5-8570-4a93-8798-33a1eb9e9e84 req-e2d67a84-f875-4dae-96b1-67413d6e4f69 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:32.743219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-137fd5a5-8570-4a93-8798-33a1eb9e9e84 req-e2d67a84-f875-4dae-96b1-67413d6e4f69 service nova] Creating event network-changed:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:09:32.750512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-137fd5a5-8570-4a93-8798-33a1eb9e9e84 req-e2d67a84-f875-4dae-96b1-67413d6e4f69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038209 Sep 13 16:09:32.751621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 187/376] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:33.471216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:33.471739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:33.479270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:33.479760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:33.480201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:33.480895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:33.481348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:33.481772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:33.497634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:33.499081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:33.507240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:33.508044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:33.508830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:33.509731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:33.511961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:33.512486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:33.683089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:33.697545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b61d43a9-85b7-40e0-b62a-e8ba50fa8ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.230051 Sep 13 16:09:33.698144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 190/377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:33.740492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:33.754736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:33.756526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:33.758136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ea3c761-0313-4b02-89ed-a132fa6562f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1747 microversion: 2.20 time: 0.266608 Sep 13 16:09:33.772586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 188/378] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1747 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:33.782535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-259fae5e-4c91-4a57-8e70-05434b6f2a91 req-72750ce1-a57e-4334-a30e-9a6bee211074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "name": "network-vif-plugged", "status": "completed", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:33.809649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-259fae5e-4c91-4a57-8e70-05434b6f2a91 req-72750ce1-a57e-4334-a30e-9a6bee211074 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:33.810137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-259fae5e-4c91-4a57-8e70-05434b6f2a91 req-72750ce1-a57e-4334-a30e-9a6bee211074 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:33.810570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-259fae5e-4c91-4a57-8e70-05434b6f2a91 req-72750ce1-a57e-4334-a30e-9a6bee211074 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:33.829682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-259fae5e-4c91-4a57-8e70-05434b6f2a91 req-72750ce1-a57e-4334-a30e-9a6bee211074 service nova] Creating event network-vif-plugged:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:09:33.835812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-259fae5e-4c91-4a57-8e70-05434b6f2a91 req-72750ce1-a57e-4334-a30e-9a6bee211074 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056788 Sep 13 16:09:33.836917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 191/379] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:34.724662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:34.725640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:34.733766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:34.734301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:34.734726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:34.736013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:34.736914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:34.737730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:34.787686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:34.788482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:34.800099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:34.801259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:34.801767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:34.802571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:34.803541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:34.804077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:34.974211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:34.988663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-534a4740-58df-493f-ad30-0e29bfe6ea85 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.270110 Sep 13 16:09:34.990134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 189/380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:35.020600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:35.042112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:35.043627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:35.044833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-006d22c7-6ba7-4515-a9e6-6759befaa78b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.262770 Sep 13 16:09:35.045427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 192/381] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:36.014843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:36.015851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:36.025658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:36.026459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:36.027087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:36.030583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:36.033171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:36.036345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:36.075484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:36.076746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:36.085561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:36.086479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:36.087998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:36.089638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:36.090493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:36.099575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:36.105656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:36.259464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:36.277051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0adc9b5-aab5-48e2-97fe-2991f97229e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1722 microversion: 2.1 time: 0.266344 Sep 13 16:09:36.286870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 190/382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:36.352455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:36.363672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:36.367393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:36.374607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01c4b8ca-05a9-4d6a-8a80-fd0b809c2e89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.300180 Sep 13 16:09:36.375535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 193/383] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:37.304137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:37.304742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:37.311627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.312100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.312564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.313234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.313831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.314099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.403566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:37.404893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:37.413025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.420337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.421133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.422263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.422734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.423361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.509300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:37.520992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d153553-023d-4157-be88-bb2333b69917 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1699 microversion: 2.1 time: 0.221920 Sep 13 16:09:37.536343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 191/384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1699 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:37.548147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29657528-9ef7-447a-bf06-aa6b1317f4e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:37.555746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29657528-9ef7-447a-bf06-aa6b1317f4e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.556914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29657528-9ef7-447a-bf06-aa6b1317f4e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.557583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29657528-9ef7-447a-bf06-aa6b1317f4e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.595874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:37.605568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:37.607433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:37.608619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05bdbe86-3fd3-401c-8c0a-3f3f4c16344f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.210945 Sep 13 16:09:37.616245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 194/385] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:37.640244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29657528-9ef7-447a-bf06-aa6b1317f4e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Going to try to start instance {{(pid=120637) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 16:09:37.690184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29657528-9ef7-447a-bf06-aa6b1317f4e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.147026 Sep 13 16:09:37.691389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 192/386] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:09:37 2022] POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:09:37.702510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:37.703150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:37.710842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.711734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.712385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.713296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:37.713995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:37.714634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:37.864142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:37.872534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-430f4d45-c842-41f4-b7f7-b63d36b9bdb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1708 microversion: 2.1 time: 0.175844 Sep 13 16:09:37.873110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 195/387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:09:38.636093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:38.636852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:38.649976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:38.650520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:38.653657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:38.656381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:38.656876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:38.657374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:38.898259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:38.899541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:38.907017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:38.907743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:38.908362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:38.909798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:38.910400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:38.911090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:38.912477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:38.922305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:38.924073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:38.927193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b4bde13-842e-499c-b50f-30ed90f0a4c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.296193 Sep 13 16:09:38.944473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 193/388] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:39.092658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:39.103660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84277726-9a93-4554-948d-83206a451e50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1708 microversion: 2.1 time: 0.209457 Sep 13 16:09:39.105090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 196/389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1708 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:39.952733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:39.953314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:39.959946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:39.960425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:39.960985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:39.961697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:39.962151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:39.962581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:40.120449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:40.129472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:40.130090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:40.139249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:40.139946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:40.140093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:40.140383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:40.141357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:40.141815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:40.142081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:40.142600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:40.143321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1b7d665-e1dc-47ec-ac1f-066932eb40a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.194367 Sep 13 16:09:40.145145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 194/390] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:40.323008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:40.332843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2eb4718-c77d-4839-8fb2-b41a2a252c15 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1708 microversion: 2.1 time: 0.207927 Sep 13 16:09:40.333764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 197/391] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1708 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:41.170123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:41.170972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:41.178393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:41.179180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:41.179852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:41.180617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:41.181067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:41.181486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:41.334304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:41.344372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:41.347063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:41.349600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56cc3001-edfa-415f-9ae6-83f191aef3a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.183641 Sep 13 16:09:41.350300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 195/392] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:41.356534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:41.357683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:41.368936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:41.369440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:41.369874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:41.370575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:41.371057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:41.371478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:41.524709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:41.533402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af103214-307e-4eaf-bb92-2a5544f6b280 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1708 microversion: 2.1 time: 0.180495 Sep 13 16:09:41.534028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 198/393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:42.377312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:42.379515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:42.386868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:42.387370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:42.388000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:42.388851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:42.389456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:42.390048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:42.535528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:42.544479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:42.545974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:42.547213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b92d81a6-7510-4b55-aaa6-22b9512568ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.174385 Sep 13 16:09:42.548362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 196/394] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:42.558339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:42.559707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:42.567046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:42.567881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:42.568606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:42.569541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:42.570212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:42.570861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:42.731474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:42.743821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9d96446-ebbb-4b8e-b431-91b483be2083 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1712 microversion: 2.1 time: 0.189729 Sep 13 16:09:42.745860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 199/395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1712 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:43.572738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:43.574013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:43.581507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:43.582430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:43.582866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:43.583604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:43.584166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:43.584557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:43.733572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:43.737863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:43.744183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:43.745716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:43.746981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae4243a6-007c-476e-8e4e-51f1d475dc40 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.178201 Sep 13 16:09:43.748071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 197/396] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:44.774107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:44.774841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:44.781185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:44.781751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:44.782254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:44.783042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:44.784113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:44.784601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:44.943801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:44.952215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:44.954168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:44.955524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d391d252-0913-45da-a32b-9cd23dc8c5c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.185420 Sep 13 16:09:44.966955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 200/397] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:45.981570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:45.982269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:45.984804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:45.992726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:45.993202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:45.993633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:45.994318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:45.994765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:45.995210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:46.128907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:46.136895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:46.138346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:46.139530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00061dd4-8e36-4ef1-9af5-83a60e3c1b53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1742 microversion: 2.20 time: 0.161835 Sep 13 16:09:46.140082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 198/398] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:09:47.164663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:47.165277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:47.172151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:47.172710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:47.173151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:47.173889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:47.175186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:47.175761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:47.323228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:47.332099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:47.333559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:47.334716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ff130e5-7407-4b8c-a19f-9f40aca1d21d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1724 microversion: 2.20 time: 0.173939 Sep 13 16:09:47.335527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 201/399] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:48.359952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:48.360565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:48.367693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:48.368184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:48.368620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:48.369323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:48.369773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:48.370196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:48.526146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:48.534732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:48.536208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:48.537563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13bdda4a-757e-4dad-948e-a660fd7cf2c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1724 microversion: 2.20 time: 0.181495 Sep 13 16:09:48.538118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 199/400] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:49.562782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:49.563420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:49.569995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:49.570475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:49.570921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:49.571635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:49.572087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:49.572511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:49.714242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:49.723365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:49.725042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:49.726407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93f78244-d8e6-49b9-9366-4349db3f74f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1724 microversion: 2.20 time: 0.167392 Sep 13 16:09:49.727121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 202/401] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:49.925441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-37f20626-ad7e-49fa-8914-0c6d7f487fcf req-aa92b130-1511-46ae-805b-3fc4ee86993f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "name": "network-vif-unplugged", "status": "completed", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:49.939102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-37f20626-ad7e-49fa-8914-0c6d7f487fcf req-aa92b130-1511-46ae-805b-3fc4ee86993f service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:49.940406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-37f20626-ad7e-49fa-8914-0c6d7f487fcf req-aa92b130-1511-46ae-805b-3fc4ee86993f service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:49.941076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-37f20626-ad7e-49fa-8914-0c6d7f487fcf req-aa92b130-1511-46ae-805b-3fc4ee86993f service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:49.953087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-37f20626-ad7e-49fa-8914-0c6d7f487fcf req-aa92b130-1511-46ae-805b-3fc4ee86993f service nova] Creating event network-vif-unplugged:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:09:49.959472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-37f20626-ad7e-49fa-8914-0c6d7f487fcf req-aa92b130-1511-46ae-805b-3fc4ee86993f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038526 Sep 13 16:09:49.960250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 200/402] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:09:50.751199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:50.752312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:50.758873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:50.759392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:50.759816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:50.760507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:50.760957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:50.761376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:50.906743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:50.906743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:50.907103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:50.907621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-414fc52b-40f5-441d-adba-400c0c326a38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1724 microversion: 2.20 time: 0.160561 Sep 13 16:09:50.908393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 203/403] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:51.933085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:51.933782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:51.941619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:51.942105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:51.942543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:51.943275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:51.943726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:51.944155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.092983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:52.101021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:52.102454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:52.103657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec6c093b-3319-4331-9fe4-d5ccb33bc434 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1667 microversion: 2.20 time: 0.174802 Sep 13 16:09:52.104377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 201/404] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1667 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:52.130204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656b3fed-cddb-42a2-899b-542b2abf3e0d"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:52.132557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:52.138841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:52.139345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:52.139777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.140449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:52.140897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:52.141316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.415051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5215d7b-9ea1-483e-8b5a-d589e931a338 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289264 Sep 13 16:09:52.415641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 204/405] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Sep 13 16:09:52 2022] POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:09:52.538959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:09:52.539555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:52.545381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:52.545854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:52.546283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.546989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:52.547441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:52.547860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.589714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120637) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 16:09:52.656111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f16daa0b-a738-4135-b89e-38e149a010f7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/action" status: 202 len: 0 microversion: 2.20 time: 0.121322 Sep 13 16:09:52.656716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 202/406] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Sep 13 16:09:52 2022] POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:09:52.664967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:52.665570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:52.672148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:52.672630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:52.673059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.673741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:52.674187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:52.674612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:52.809321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:52.821246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:52.822794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:52.823981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c71cd212-a1c6-48eb-9e55-94778a52f6fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1753 microversion: 2.20 time: 0.162861 Sep 13 16:09:52.824522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 205/407] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:53.851113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:53.851938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:53.858513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:53.859177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:53.859727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:53.860516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:53.861043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:53.861538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:54.044362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:54.055937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:54.057722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:54.059097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5da00686-9c3a-4a94-908a-7acffe8371fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1753 microversion: 2.20 time: 0.213248 Sep 13 16:09:54.059618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 203/408] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:55.085183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:55.085818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:55.092390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:55.092878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:55.093310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:55.093994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:55.094445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:55.094868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:55.114731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:55.115360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:55.122227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:55.122657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:55.123126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:55.123825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:55.124546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:55.124973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:55.224748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:55.233527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:55.235016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:55.236174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3ac4ec3-2b9a-4d94-af45-d2a91e0e733b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.155558 Sep 13 16:09:55.236737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 206/409] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:55.252591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lazy-loading 'services' on Instance uuid ba0d63f8-999b-48cd-beb6-455e05ee57e6 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:09:55.370570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70914539-c387-40b7-8dc5-e49ed865142b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6/os-volume_attachments/c73ace70-d10d-459e-b09f-6acec9948094" status: 202 len: 0 microversion: 2.1 time: 0.260043 Sep 13 16:09:55.374746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 204/410] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:09:55 2022] DELETE /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6/os-volume_attachments/c73ace70-d10d-459e-b09f-6acec9948094 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:09:56.261433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:56.262149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:56.269005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:56.269492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:56.269930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:56.270634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:56.271166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:56.271600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:56.287332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:09:56.405342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:56.415453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:56.416908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:56.418069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a77981f8-5549-4883-b633-11ac6a3a2921 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.160485 Sep 13 16:09:56.418627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 207/411] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:56.497407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:56.497992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:56.505260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:56.505672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:56.506103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:56.506784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:56.507261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:56.507680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:56.533712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:09:56.616055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d2e15cb-83b7-4a0f-8eeb-18b4e29759ac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 204 len: 0 microversion: 2.1 time: 0.122534 Sep 13 16:09:56.620130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 205/412] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:09:56 2022] DELETE /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:09:56.625414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:56.626024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:56.632517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:56.632998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:56.633434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:56.634127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:56.634578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:56.635027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:56.773216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:56.781375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4004cb39-1b0c-4347-9005-e57bc294d7aa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.159969 Sep 13 16:09:56.782066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 208/413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:56 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:57.444007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:57.445768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:57.450547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:57.451058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:57.451527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:57.452209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:57.452652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:57.453096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:57.581443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:57.589904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:57.591371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:57.592811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b6b25d9a-96fe-4344-a075-12aa79d179de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.153191 Sep 13 16:09:57.593365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 206/414] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:57.804895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:57.805497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:57.812011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:57.812520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:57.812950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:57.813630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:57.814077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:57.814496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:57.952044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:57.959867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a06a2411-b5f9-41f6-9ec5-73411d917b4c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.158917 Sep 13 16:09:57.960425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 209/415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:57 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:58.618988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:58.619629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:58.626281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:58.626765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:58.627243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:58.628756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:58.629215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:58.629644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:58.768702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:58.778337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:58.779813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:58.781202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21651c4b-58c5-449a-8ea1-648bde84d35f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.166259 Sep 13 16:09:58.781890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 207/416] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:09:58.982701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:58.983259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:58.992260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:58.993216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:58.994453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:58.995590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:58.996569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:58.997369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:59.144544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:59.152280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a6b5437-a9c9-4737-902e-43c00fa464ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.173450 Sep 13 16:09:59.152836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 210/417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:09:58 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:09:59.809419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:09:59.810024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:09:59.816548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:59.817022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:59.817454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:59.818133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:09:59.818579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:09:59.819091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:09:59.955464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:59.965026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:59.966475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:09:59.967848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ce3266c-0e32-451f-873c-0e9b2ae1b0db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.162260 Sep 13 16:09:59.968399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 208/418] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:09:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:00.181744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:00.182452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:00.189335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:00.189830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:00.190862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:00.191583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:00.192047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:00.192478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:00.328312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:00.336927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cacc9fea-e056-4ec0-8374-c943bcf260c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.159065 Sep 13 16:10:00.350927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 211/419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:00 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:00.992813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:00.993370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:00.999967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:01.000446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:01.000884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:01.001568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:01.002019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:01.002441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:01.149077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:01.157888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:01.159982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:01.161330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13a43b9f-1371-494c-9b1e-0140ea7df373 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.172312 Sep 13 16:10:01.162026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 209/420] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:01.361666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:01.363201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:01.365560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=50 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:01.371661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:01.372019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:01.372458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:01.373198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:01.373653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:01.374355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:01.512213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:01.520643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-380b3f3e-017a-4af6-b636-7fe8a42b0ecd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.162939 Sep 13 16:10:01.521288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 212/421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:01 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:02.190400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:02.191075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:02.200078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:02.200669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:02.201306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:02.202107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:02.202821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:02.203347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:02.337804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:02.347039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:02.348590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:02.349747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdfb28cd-aa4e-4628-a63e-749c21de6108 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.165908 Sep 13 16:10:02.350291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 210/422] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:02.543550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:02.544251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:02.550794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:02.551339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:02.551791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:02.552476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:02.552952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:02.553378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:02.696876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:02.706668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f58f6a1-2c83-44cb-b743-8be8d8408a80 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.165822 Sep 13 16:10:02.707463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 213/423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:02 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:03.375988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:03.376635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:03.383533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:03.384013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:03.384445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:03.385136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:03.385587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:03.386007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:03.526269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:03.529822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:03.535728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:03.537172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:03.538324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8eaa9b24-666f-4842-ad6f-22582bcebd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.166462 Sep 13 16:10:03.538876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 211/424] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:03.730230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:03.730960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:03.737555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:03.738560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:03.739040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:03.739741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:03.740195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:03.740620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:03.880845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:03.889167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6255a0bb-9158-476f-aad8-6c8841190cc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.162878 Sep 13 16:10:03.889746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 214/425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:03 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:04.565006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:04.565612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:04.573068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:04.573551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:04.573978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:04.574669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:04.575150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:04.575569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:04.713649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:04.722154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:04.723628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:04.725458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-067a8572-79c8-472f-9ce7-589ee46d6a5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.165004 Sep 13 16:10:04.726020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 212/426] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:04.913152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:04.913766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:04.920406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:04.920896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:04.921341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:04.922041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:04.922495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:04.922936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:05.064797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:05.074031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-208dc9c1-0f6f-4f74-82af-b1a3905767bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.165293 Sep 13 16:10:05.074798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 215/427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:04 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:05.751767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:05.752355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:05.759332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:05.759809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:05.760234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:05.760930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:05.761376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:05.761798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:05.895656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:05.904350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:05.905790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:05.906975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9116254-22d0-4e45-a7b3-eb2c782d40ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.159780 Sep 13 16:10:05.907535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 213/428] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:06.099540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:06.100207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:06.106598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:06.107113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:06.107549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:06.108232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:06.108682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:06.109108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:06.244861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:06.254058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9323fc0f-592d-4c16-a056-1716e410008e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.158172 Sep 13 16:10:06.254751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 216/429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:06 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:06.796240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:06.797792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:06.805814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:06.806669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:06.807514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:06.808233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:06.808686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:06.809109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:06.835212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86d38b5a-7df7-4f27-b681-72ddfdc2b343 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/ips" status: 200 len: 150 microversion: 2.1 time: 0.043240 Sep 13 16:10:06.835850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 214/430] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:10:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:06.933050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:06.933768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:06.940717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:06.941221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:06.941814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:06.942578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:06.943189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:06.943948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:07.119481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:07.135095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:07.137013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:07.138543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4b5afb0f-1c9b-473d-afb5-d16a5d1edf07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.209586 Sep 13 16:10:07.152355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 217/431] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:07.278450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:07.279105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:07.285038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:07.285531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:07.285974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:07.286670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:07.287198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:07.287649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:07.432363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:07.440751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1837b651-0946-4615-805f-57868a090913 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.166049 Sep 13 16:10:07.441576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 215/432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:07 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:08.185520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:08.187010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:08.194999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:08.195888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:08.196567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:08.197536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:08.198238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:08.198987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:08.296745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a788e0d-23d3-4768-8cd6-ce705e349002"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:08.300031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:08.309197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:08.310079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:08.310614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:08.311446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:08.312120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:08.312617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:08.595180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:08.603870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:08.605265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:08.606445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d917a95-1ad3-490c-856a-782283f4fe66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.441883 Sep 13 16:10:08.607025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 218/433] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:08.611636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:08.612547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:08.619232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:08.619947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:08.620564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:08.621429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:08.622048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:08.622630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:08.751093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:08.759880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ebd27c0-05d3-479e-a829-7d4d64846603 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.151688 Sep 13 16:10:08.760649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 219/434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:08 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:09.632094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:09.632743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:09.638801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:09.639329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:09.639772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:09.640462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:09.640920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:09.641351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:09.770347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:09.779612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:09.781061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:09.782216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d2afc56-0705-441a-9fa8-f0051af1babb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.154175 Sep 13 16:10:09.782798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 220/435] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:10:09.787887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:09.788538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:09.794746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:09.795266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:09.795712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:09.796410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:09.796867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:09.797296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:09.924676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:09.933288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e23d5bd-570a-4dec-8a04-bbcc28b4ea4b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1513 microversion: 2.1 time: 0.149537 Sep 13 16:10:09.933840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 221/436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:09 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:10.201286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-602371dd-8f2d-45ee-8e77-ee8589e2c1af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.908508 Sep 13 16:10:10.201886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 216/437] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:10:08 2022] POST /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 194 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:10:10.634673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-ad16b9f1-a61c-4da0-a520-72ff2f158dbd req-7073245f-da12-4dd1-b8bb-08408196d981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0d63f8-999b-48cd-beb6-455e05ee57e6", "name": "network-vif-deleted", "tag": "bd46e302-1b2f-4e05-a948-3114c001bfa2"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:10.648948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ad16b9f1-a61c-4da0-a520-72ff2f158dbd req-7073245f-da12-4dd1-b8bb-08408196d981 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:10.649490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ad16b9f1-a61c-4da0-a520-72ff2f158dbd req-7073245f-da12-4dd1-b8bb-08408196d981 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:10.649924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ad16b9f1-a61c-4da0-a520-72ff2f158dbd req-7073245f-da12-4dd1-b8bb-08408196d981 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:10.664732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-ad16b9f1-a61c-4da0-a520-72ff2f158dbd req-7073245f-da12-4dd1-b8bb-08408196d981 service nova] Creating event network-vif-deleted:bd46e302-1b2f-4e05-a948-3114c001bfa2 for instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 on hv-cinder-82002 Sep 13 16:10:10.670182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-ad16b9f1-a61c-4da0-a520-72ff2f158dbd req-7073245f-da12-4dd1-b8bb-08408196d981 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040038 Sep 13 16:10:10.671464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 222/438] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:10.809725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:10.810869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:10.817739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:10.819205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:10.819748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:10.820831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:10.821537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:10.822285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:10.954507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:10.957869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:10.959275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:10.964817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:10.965387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:10.965902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:10.966398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:10.966522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:10.967078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:10.967534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:10.967964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:10.968071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c1b618a-d108-4753-84a6-c8a643a40103 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.162410 Sep 13 16:10:10.968685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 217/439] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:10.999243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:10.999744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:11.000173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:11.000609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lazy-loading 'fault' on Instance uuid ba0d63f8-999b-48cd-beb6-455e05ee57e6 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:10:11.042393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:11.050187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28cb6683-62d8-4443-8b25-7bc755e846a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 200 len: 1309 microversion: 2.1 time: 0.096607 Sep 13 16:10:11.050750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 223/440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:10 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:11.994241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:11.995453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:12.002127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:12.002830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:12.003325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:12.004021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:12.004470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:12.004900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:12.073704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:12.074334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: ba0d63f8-999b-48cd-beb6-455e05ee57e6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:12.080851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:12.081336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:12.081771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:12.082467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:12.082930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:12.083444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:12.088487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:12.099884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] HTTP exception thrown: Instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 could not be found. Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Request method failure captured: Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 HTTP/1.1 Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsR34bSGiPVEW6S8GDBemZIZiTc_ICqUjYvTdHfDKIRS4N-Qmxq3GowVo0cPlhNItkKh4k5KLdrkaUmlnl-C34QUscMXxxFod8UgzRKZF8oU2lvkWmOcf31clES0nIp3G2vN41bTgRKVItHEmPJX5j77_9FXu5TzfBOQ95Osw8LXPA Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 673d53e0757746708c6ca7b9d947b409 Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1766466804 Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:10:12.101528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/673d53e0757746708c6ca7b9d947b409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/673d53e0757746708c6ca7b9d947b409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/673d53e0757746708c6ca7b9d947b409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_673d53e0757746708c6ca7b9d947b409"}]}] Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotTestJSON-1766466804 Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 673d53e0757746708c6ca7b9d947b409 Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1766466804 Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotTestJSON-1766466804-project Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 313ac02befbf44ebabf3b41f84245c1f Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotTestJSON-1766466804-project Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 could not be found. Sep 13 16:10:12.103157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ba0d63f8-999b-48cd-beb6-455e05ee57e6'} Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 could not be found. Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:10:12.104357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 could not be found. Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 could not be found. Sep 13 16:10:12.105812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:10:12.107103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Returning 404 to user: Instance ba0d63f8-999b-48cd-beb6-455e05ee57e6 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:10:12.107103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f87170fb-f93f-4f3d-b09b-6586276afe86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6" status: 404 len: 111 microversion: 2.1 time: 0.033069 Sep 13 16:10:12.107882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 224/441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:12 2022] GET /compute/v2.1/servers/ba0d63f8-999b-48cd-beb6-455e05ee57e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:10:12.156484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:12.167501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:12.168969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:12.170139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-187687b9-84c7-44c8-8aec-bf3230a4cf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.181077 Sep 13 16:10:12.170689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 218/442] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:13.196866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:13.197482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:13.203934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:13.204420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:13.204862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:13.205551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:13.206007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:13.206436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:13.337661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:13.346200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:13.347681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:13.349465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-acc3dd80-e9cd-4e9a-81ef-d0dd7f02b6d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.156350 Sep 13 16:10:13.350023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 225/443] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:14.374718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:14.375393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:14.382105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:14.382591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:14.383058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:14.383755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:14.384209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:14.384635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:14.513668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:14.523045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:14.524517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:14.525668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d598dd34-29a9-4523-b37a-38addc6f6028 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.155068 Sep 13 16:10:14.526222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 219/444] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:15.551546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:15.552555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:15.560595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:15.561503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:15.561952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:15.562666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:15.563142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:15.563568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:15.697705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:15.707705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:15.709931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:15.711114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05775381-9faf-438e-864a-391ba294c3b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.163687 Sep 13 16:10:15.711666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 226/445] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:16.736513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:16.737213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:16.740627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:16.746607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:16.747117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:16.747563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:16.748526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:16.748972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:16.749391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:16.887154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:16.896125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:16.897804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:16.898969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e22f8b5-c1b2-4be4-8066-8506b4754467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.166420 Sep 13 16:10:16.899527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 220/446] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:17.924358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:17.924979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:17.932293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:17.932767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:17.933198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:17.933884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:17.934331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:17.934751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:18.073191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:18.081666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:18.083271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:18.084420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2201f918-5907-4be0-a2be-49f316739c4d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.163893 Sep 13 16:10:18.084972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 227/447] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:18.811849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5d93195-2aef-483d-a4e5-fab5cca5ad05 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: .version_select at 0x7fb67c2cbf70>, body: {"keypair": {"name": "tempest-keypair-900529941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhjQ7wOn6+3J5tvWVo2Zvq7XPrj8FmfDY4WJ4WEnPcSlixVMqb6u/uZRzd33tOZsXeXjrw4dPX6N2kz30r/lGRpabqWWLC6KmtWjKthwOuJ9DdpsOYJAqfDhNuv6Ro0oQ=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:18.827663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-a5d93195-2aef-483d-a4e5-fab5cca5ad05 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:10:18.831990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-a5d93195-2aef-483d-a4e5-fab5cca5ad05 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:10:18.846368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5d93195-2aef-483d-a4e5-fab5cca5ad05 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [e63e9c52-00c3-4b2e-bc70-12e25a730645] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:10:19.109603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:19.110201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:19.116846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:19.117328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:19.117767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:19.118471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:19.118907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:19.119354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:19.244595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:19.253371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:19.255523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:19.256677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a089ab50-df86-441f-bde7-3475edc9cecf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.150949 Sep 13 16:10:19.257226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 228/448] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:10:19.856349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5d93195-2aef-483d-a4e5-fab5cca5ad05 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [e63e9c52-00c3-4b2e-bc70-12e25a730645] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46264. Sep 13 16:10:19.872376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5d93195-2aef-483d-a4e5-fab5cca5ad05 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.064234 Sep 13 16:10:19.873206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 221/449] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:10:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:20.042655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-92811555", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "networks": [{"uuid": "7e5addac-2dfb-4a49-b11a-4aa634ec4ae0"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:20.103538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] validate_networks() for [('7e5addac-2dfb-4a49-b11a-4aa634ec4ae0', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:10:20.290170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:20.290822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:20.298029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:20.298521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:20.299491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:20.300212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:20.300667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:20.301673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:20.559030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:20.570571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:20.572029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:20.573214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2863e22-a4ae-43f7-b090-9ccf7709e041 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.294956 Sep 13 16:10:20.573930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 222/450] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:20.673056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:10:20.673539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:10:20.674086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:10:20.674569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:10:20.675085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:10:20.684910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:20.685472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:20.685978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:20.686778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:20.687349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:20.687872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:20.704936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Getting quotas for project 673d53e0757746708c6ca7b9d947b409. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:10:20.709453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Getting quotas for user 313ac02befbf44ebabf3b41f84245c1f and project 673d53e0757746708c6ca7b9d947b409. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:10:20.720749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:10:20.723692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:10:20.767837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [8fe5a471-edbe-4a63-94f8-18bd2156dea6] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:10:21.600117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:21.600822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:21.607320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:21.607983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:21.608362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:21.609052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:21.609498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:21.609936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:21.754288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:21.763553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:21.764998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:21.766170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43c89c8e-a08a-44e3-b0cc-54fae6a3fc38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.171044 Sep 13 16:10:21.766708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 223/451] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:10:21.773682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1186411814", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90fe5e9a-9ff6-4724-a98f-1f72ad00105b"}], "security_groups": [{"name": "tempest-securitygroup--637221306"}], "key_name": "tempest-keypair-900529941", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:21.786967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [8fe5a471-edbe-4a63-94f8-18bd2156dea6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46296. Sep 13 16:10:21.791529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad14c967-0d71-4560-a607-adaada10904f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.752472 Sep 13 16:10:21.792245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 229/452] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:10:21.806481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22a337a9-f56a-4935-a072-b0ae3c30ccd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:21.807379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22a337a9-f56a-4935-a072-b0ae3c30ccd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:21.877613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22a337a9-f56a-4935-a072-b0ae3c30ccd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:21.885385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22a337a9-f56a-4935-a072-b0ae3c30ccd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1217 microversion: 2.1 time: 0.083850 Sep 13 16:10:21.886392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 230/453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:21 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:21.907642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] validate_networks() for [('90fe5e9a-9ff6-4724-a98f-1f72ad00105b', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:10:22.129818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3c698806-d5c8-4c51-8912-02b2e2006d02 req-2e9b325e-cedd-4704-a055-43ebbd3733a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "name": "network-vif-plugged", "status": "completed", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:22.146150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3c698806-d5c8-4c51-8912-02b2e2006d02 req-2e9b325e-cedd-4704-a055-43ebbd3733a9 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.146885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3c698806-d5c8-4c51-8912-02b2e2006d02 req-2e9b325e-cedd-4704-a055-43ebbd3733a9 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.147513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3c698806-d5c8-4c51-8912-02b2e2006d02 req-2e9b325e-cedd-4704-a055-43ebbd3733a9 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.159138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3c698806-d5c8-4c51-8912-02b2e2006d02 req-2e9b325e-cedd-4704-a055-43ebbd3733a9 service nova] Creating event network-vif-plugged:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:10:22.164797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3c698806-d5c8-4c51-8912-02b2e2006d02 req-2e9b325e-cedd-4704-a055-43ebbd3733a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039323 Sep 13 16:10:22.165708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 231/454] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:10:22.320953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:10:22.321375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:10:22.321850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:10:22.322257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:10:22.322713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:10:22.331632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.332135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.333481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.334215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.334692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.335227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.356763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:10:22.365279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:10:22.381741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:10:22.384000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:10:22.432532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0983d33c-a581-4862-a085-ba4b9caff843 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.664621 Sep 13 16:10:22.433189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 224/455] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:10:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:10:22.445767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2f901cb-b82c-453d-8b66-d242984a926e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:22.446468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2f901cb-b82c-453d-8b66-d242984a926e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:22.502962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2f901cb-b82c-453d-8b66-d242984a926e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:22.510819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2f901cb-b82c-453d-8b66-d242984a926e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1241 microversion: 2.1 time: 0.069738 Sep 13 16:10:22.511654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 232/456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:22 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:22.794351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:22.795135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:22.805112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.805670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.806028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.806731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.807205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.807703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.909224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:22.909727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:22.916436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.916921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.917360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.918045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:22.918490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:22.918923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:22.941782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:22.950840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:22.952322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:22.953601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5ceb3ad-8511-4a1f-9811-486c502084cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.165053 Sep 13 16:10:22.954158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 225/457] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:22.981929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:22.990082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af3112da-a7a2-45f5-b09a-47468e699c94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1269 microversion: 2.1 time: 0.084714 Sep 13 16:10:22.990626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 233/458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:22 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:23.534030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:23.534590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:23.541176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:23.541656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:23.542094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:23.542781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:23.543259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:23.543688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:23.603046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:23.610599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89c25747-468b-443b-bc73-bea65caa0ebc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1237 microversion: 2.1 time: 0.080489 Sep 13 16:10:23.611175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 226/459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:23 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:23.979917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:23.980529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:23.986921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:23.987407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:23.987844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:23.988762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:23.989232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:23.989675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:24.013349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:24.014059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:24.021398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:24.021886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:24.022319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:24.023256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:24.023707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:24.024130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:24.101471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:24.109655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e61a6b8-ab60-4e5d-b4fd-8b07910f5d6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1277 microversion: 2.1 time: 0.100290 Sep 13 16:10:24.110237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 227/460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:24 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:24.147497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:24.155997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:24.157437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:24.158579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb4e8650-dcdf-4094-a0f6-68be4cca0685 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.182611 Sep 13 16:10:24.159157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 234/461] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:10:24.634286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:24.634918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:24.643823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:24.644316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:24.644878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:24.647509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:24.647976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:24.648410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:24.746774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:24.767962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1b058501-f105-4243-a9c4-45ff5db3f855 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1293 microversion: 2.1 time: 0.137088 Sep 13 16:10:24.768798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 228/462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:24 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:25.133627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:25.134408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:25.140869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:25.141449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:25.141896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:25.142587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:25.143155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:25.143578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:25.188457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:25.199848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:25.210868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:25.211495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:25.212004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:25.213008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:25.213531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:25.214027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:25.218719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:25.370477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:25.384779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-893ff02d-7ab9-456a-bb40-16fbbca36b6c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1317 microversion: 2.1 time: 0.255516 Sep 13 16:10:25.388401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 235/463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:25.456865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:25.466525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:25.468326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:25.469776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ab03a8d-840c-4d27-9e9d-55145bedb560 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1811 microversion: 2.20 time: 0.288596 Sep 13 16:10:25.470507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 229/464] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1811 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:10:25.793192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:25.793919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:25.800076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:25.801662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:25.802156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:25.802864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:25.803350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:25.803775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:25.880822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:25.891427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbf61848-9bce-4238-9223-45155cbeca35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1299 microversion: 2.1 time: 0.102380 Sep 13 16:10:25.892349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 236/465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:25 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:26.046604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4d7c1827-689d-489d-9303-9240bd783ae3 req-b7eec03e-761c-4d60-9696-7da6da6ded25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325211a3-a74a-48fb-b693-e9340461ed2d", "tag": "fe971ca6-2183-4fd6-8985-8d2e9bae7e50"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:26.067791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4d7c1827-689d-489d-9303-9240bd783ae3 req-b7eec03e-761c-4d60-9696-7da6da6ded25 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.068284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4d7c1827-689d-489d-9303-9240bd783ae3 req-b7eec03e-761c-4d60-9696-7da6da6ded25 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.068712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4d7c1827-689d-489d-9303-9240bd783ae3 req-b7eec03e-761c-4d60-9696-7da6da6ded25 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.085958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4d7c1827-689d-489d-9303-9240bd783ae3 req-b7eec03e-761c-4d60-9696-7da6da6ded25 service nova] Creating event network-changed:fe971ca6-2183-4fd6-8985-8d2e9bae7e50 for instance 325211a3-a74a-48fb-b693-e9340461ed2d on hv-cinder-82002 Sep 13 16:10:26.092543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4d7c1827-689d-489d-9303-9240bd783ae3 req-b7eec03e-761c-4d60-9696-7da6da6ded25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050980 Sep 13 16:10:26.093141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 230/466] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:26.412091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:26.413673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:26.421195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.421826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.422971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.424136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.424780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.425389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.496345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:26.497331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:26.504524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.505002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.505436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.506127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.506572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.507020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.924560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:26.932573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af8910b1-ed09-48e9-80e0-cbe0d6378333 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1317 microversion: 2.1 time: 0.524610 Sep 13 16:10:26.933144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 237/467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:26 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:26.937599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:26.938201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:26.944538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.945091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.945536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.946239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:26.946695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:26.947227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:26.977374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:26.986077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:26.987567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:26.989096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34c51d97-6bd6-4c58-987e-fe4db332fd52 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1798 microversion: 2.20 time: 0.496872 Sep 13 16:10:26.989657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 231/468] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:10:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1798 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:10:27.182611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:27.191493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c22ce20a-1b78-44fc-b727-d2b0b5df4a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.257145 Sep 13 16:10:27.207167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 238/469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:26 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:27.389441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-7ac204e9-bad1-4531-8a9d-72047b0aa712 req-7e069a59-a5b5-4c76-b4f4-796e8b80656d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f346b6b-2791-48f9-be20-2c8defa26b50", "tag": "c13b562b-381d-44e3-ac35-611b6c7cd637"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:27.399210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7ac204e9-bad1-4531-8a9d-72047b0aa712 req-7e069a59-a5b5-4c76-b4f4-796e8b80656d service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:27.399685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7ac204e9-bad1-4531-8a9d-72047b0aa712 req-7e069a59-a5b5-4c76-b4f4-796e8b80656d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:27.400113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7ac204e9-bad1-4531-8a9d-72047b0aa712 req-7e069a59-a5b5-4c76-b4f4-796e8b80656d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:27.410824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-7ac204e9-bad1-4531-8a9d-72047b0aa712 req-7e069a59-a5b5-4c76-b4f4-796e8b80656d service nova] Creating event network-changed:c13b562b-381d-44e3-ac35-611b6c7cd637 for instance 8f346b6b-2791-48f9-be20-2c8defa26b50 on hv-cinder-82002 Sep 13 16:10:27.416990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-7ac204e9-bad1-4531-8a9d-72047b0aa712 req-7e069a59-a5b5-4c76-b4f4-796e8b80656d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031604 Sep 13 16:10:27.417579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 232/470] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:27.964940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:27.965646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:27.973011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:27.973448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:27.974008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:27.974797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:27.975198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:27.975633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:28.124903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:28.134613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c06aef8a-01a8-4dd1-b0e6-6a48f7b20259 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1317 microversion: 2.1 time: 0.181624 Sep 13 16:10:28.135333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 239/471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:27 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:28.214536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:28.215407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:28.221793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:28.222275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:28.222738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:28.223630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:28.224084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:28.224513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:28.263441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f285f277-588c-47f2-a0c3-7c605acf3904"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:28.265914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:28.274582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:28.275114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:28.275585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:28.276281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:28.276767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:28.277195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:28.356954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:28.365229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bdd12b58-3c49-4c40-b264-8ce97d116ac8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.154793 Sep 13 16:10:28.365796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 233/472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:28 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:29.159497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:29.160684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:29.166595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:29.167117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:29.167557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:29.168247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:29.168702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:29.169127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:29.298761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:29.307239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dacf178c-e172-4c2a-8d98-483000f81360 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1317 microversion: 2.1 time: 0.151473 Sep 13 16:10:29.307814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 234/473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:29 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:29.388840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:29.389447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:29.396140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:29.396624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:29.397077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:29.397897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:29.398438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:29.399182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:29.427892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37707ebd-7b2b-4d71-8d53-39df4fc2a704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.168381 Sep 13 16:10:29.428677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 240/474] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:10:28 2022] POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 194 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:10:29.536198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:29.544039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-220c28fb-16cb-45c6-ab33-4522da6cba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.159033 Sep 13 16:10:29.544606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 235/475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:29 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:30.272145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-40ac2bf3-07f1-4ad3-bf5e-419e7f818d2a req-2c6b3998-7284-4824-8275-d5a833b5351a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325211a3-a74a-48fb-b693-e9340461ed2d", "name": "network-vif-plugged", "status": "completed", "tag": "fe971ca6-2183-4fd6-8985-8d2e9bae7e50"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:30.282470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-40ac2bf3-07f1-4ad3-bf5e-419e7f818d2a req-2c6b3998-7284-4824-8275-d5a833b5351a service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:30.282965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-40ac2bf3-07f1-4ad3-bf5e-419e7f818d2a req-2c6b3998-7284-4824-8275-d5a833b5351a service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:30.283397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-40ac2bf3-07f1-4ad3-bf5e-419e7f818d2a req-2c6b3998-7284-4824-8275-d5a833b5351a service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:30.297608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-40ac2bf3-07f1-4ad3-bf5e-419e7f818d2a req-2c6b3998-7284-4824-8275-d5a833b5351a service nova] Creating event network-vif-plugged:fe971ca6-2183-4fd6-8985-8d2e9bae7e50 for instance 325211a3-a74a-48fb-b693-e9340461ed2d on hv-cinder-82002 Sep 13 16:10:30.302489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-40ac2bf3-07f1-4ad3-bf5e-419e7f818d2a req-2c6b3998-7284-4824-8275-d5a833b5351a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035181 Sep 13 16:10:30.303264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 241/476] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:30.329467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:30.330080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:30.337218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:30.337950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:30.338389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:30.339203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:30.339567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:30.339992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:30.473010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:30.481331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71cdf4af-ce62-42da-b6c5-690fa992c304 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1317 microversion: 2.1 time: 0.155632 Sep 13 16:10:30.481895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 236/477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:30.568181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:30.568881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:30.575547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:30.576023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:30.576455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:30.577129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:30.577573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:30.577990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:30.695516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:30.717097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:30.726094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16a01c11-d531-4826-8d6c-59932be9aa6c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.162360 Sep 13 16:10:30.726595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 242/478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:30 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:31.503889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:31.504495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:31.510573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:31.511075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:31.511509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:31.512187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:31.512642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:31.513053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:31.640542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:31.648754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a5f5055-610e-4156-b3f2-aa0a4120ef11 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1317 microversion: 2.1 time: 0.148673 Sep 13 16:10:31.649316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 237/479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:31 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:31.751164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:31.751776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:31.754657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:31.760018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:31.760508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:31.760951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:31.761644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:31.762099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:31.762534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:31.892764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:31.901067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-446df818-1104-4fc4-bb43-af7cc591746a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.154068 Sep 13 16:10:31.901635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 243/480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:31 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:32.324044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f2cbb57f-80b2-4262-acb1-4fc7a72e4b67 req-e2cce588-567b-4851-8404-eb866cd44f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f346b6b-2791-48f9-be20-2c8defa26b50", "name": "network-vif-plugged", "status": "completed", "tag": "c13b562b-381d-44e3-ac35-611b6c7cd637"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:32.333601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2cbb57f-80b2-4262-acb1-4fc7a72e4b67 req-e2cce588-567b-4851-8404-eb866cd44f9a service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.334070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2cbb57f-80b2-4262-acb1-4fc7a72e4b67 req-e2cce588-567b-4851-8404-eb866cd44f9a service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.334496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2cbb57f-80b2-4262-acb1-4fc7a72e4b67 req-e2cce588-567b-4851-8404-eb866cd44f9a service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:32.345179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:32.347820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f2cbb57f-80b2-4262-acb1-4fc7a72e4b67 req-e2cce588-567b-4851-8404-eb866cd44f9a service nova] Creating event network-vif-plugged:c13b562b-381d-44e3-ac35-611b6c7cd637 for instance 8f346b6b-2791-48f9-be20-2c8defa26b50 on hv-cinder-82002 Sep 13 16:10:32.353215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f2cbb57f-80b2-4262-acb1-4fc7a72e4b67 req-e2cce588-567b-4851-8404-eb866cd44f9a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Sep 13 16:10:32.353787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 238/481] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:32.671697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:32.672313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:32.674577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=10 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:32.680639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.681120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.681748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:32.682441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.682891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.683336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:32.687311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:32.812638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:32.820305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5cb56891-8a38-4cc8-9e28-0a4acad42f41 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1505 microversion: 2.1 time: 0.152352 Sep 13 16:10:32.820975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 244/482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:32.840474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:32.845575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a912fb3-c458-4d52-984e-06017f8697d7", "device": "/dev/sdb"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:32.848020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:32.854985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.855464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.855927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:32.856612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.857076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.857483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:32.923719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:32.924402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:32.930520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.931039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.931480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:32.932171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:32.932622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:32.933049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:33.072263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:33.079946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f93096d-185b-4219-80f8-815ce20149c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.160011 Sep 13 16:10:33.080768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 245/483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:32 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:10:33.111584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0bc05c88-4907-47ae-ba96-5de68d16a998 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "POST /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271687 Sep 13 16:10:33.112183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 239/484] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:10:32 2022] POST /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:34.105417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:34.106458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:34.115717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:34.116197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:34.116632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:34.117321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:34.117774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:34.118205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:34.263717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:34.272109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b0c691d3-c628-4e2e-9b9c-d1bb614dfc2f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1366 microversion: 2.1 time: 0.172113 Sep 13 16:10:34.272681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 246/485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:34 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:34.473478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:34.474098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:34.483986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:34.484910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:34.485637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:34.486808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:34.487471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:34.487913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:34.607590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lazy-loading 'services' on Instance uuid de8c6aa1-3270-40d0-88f2-196f26018b5c {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:10:34.707563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51678878-ab07-4799-9d07-ba2c502b009d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments/fe9dd007-30cc-4611-96e4-63abde6e68a7" status: 202 len: 0 microversion: 2.1 time: 0.241238 Sep 13 16:10:34.708875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 240/486] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:10:34 2022] DELETE /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments/fe9dd007-30cc-4611-96e4-63abde6e68a7 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:10:35.295144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:35.295776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:35.302344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:35.302825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:35.303294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:35.303986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:35.304471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:35.304897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:35.432897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:35.440561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d05f302-e072-416e-852c-339ca8b365b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1556 microversion: 2.1 time: 0.149256 Sep 13 16:10:35.441125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 247/487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:35 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:35.464579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:35.465171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:35.471816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:35.472300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:35.472736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:35.473456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:35.473908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:35.474470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:35.557420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-362f5a1b-a53c-4de7-9ee2-a737b6b06792 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097012 Sep 13 16:10:35.558011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 241/488] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:10:35 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:36.736665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-70fe3c76-0c29-49ac-8b61-82e010323a3b req-828f3a28-247f-485d-ab10-4d0b704e7a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f346b6b-2791-48f9-be20-2c8defa26b50", "tag": "c13b562b-381d-44e3-ac35-611b6c7cd637"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:36.746873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-70fe3c76-0c29-49ac-8b61-82e010323a3b req-828f3a28-247f-485d-ab10-4d0b704e7a3d service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:36.747524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-70fe3c76-0c29-49ac-8b61-82e010323a3b req-828f3a28-247f-485d-ab10-4d0b704e7a3d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:36.748038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-70fe3c76-0c29-49ac-8b61-82e010323a3b req-828f3a28-247f-485d-ab10-4d0b704e7a3d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:36.759134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-70fe3c76-0c29-49ac-8b61-82e010323a3b req-828f3a28-247f-485d-ab10-4d0b704e7a3d service nova] Creating event network-changed:c13b562b-381d-44e3-ac35-611b6c7cd637 for instance 8f346b6b-2791-48f9-be20-2c8defa26b50 on hv-cinder-82002 Sep 13 16:10:36.764421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-70fe3c76-0c29-49ac-8b61-82e010323a3b req-828f3a28-247f-485d-ab10-4d0b704e7a3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Sep 13 16:10:36.765015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 248/489] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:10:37.039270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:10:37.042297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:37.048887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:37.049467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:37.050015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:37.050869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:37.051931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:37.052526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:37.076487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lazy-loading 'flavor' on Instance uuid 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:10:37.212926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1080f042-53db-4afb-9fb9-3d5b016d2837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/action" status: 200 len: 32 microversion: 2.1 time: 0.179691 Sep 13 16:10:37.213543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 242/490] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:10:37 2022] POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:10:37.224125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:37.224823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:37.230882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:37.235610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:37.236352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:37.237334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:37.238015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:37.239584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:37.481360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:37.489957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb625191-579e-4b25-b957-b5fc643e4820 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.270668 Sep 13 16:10:37.490628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 249/491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:38.513998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:38.514699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:38.521312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:38.521798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:38.522237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:38.522949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:38.523407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:38.523839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:38.654315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:38.663135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee7ec2aa-63eb-4181-b7d2-6dd720518d54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153362 Sep 13 16:10:38.663698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 243/492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:39.687048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:39.687649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:39.694490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:39.694999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:39.695436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:39.696110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:39.696560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:39.696981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:39.825734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:39.834412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5607213-20d9-4595-8dbb-5caf4169c463 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151347 Sep 13 16:10:39.834991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 250/493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:40.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:40.858110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:40.865237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:40.865720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:40.866154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:40.866840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:40.867333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:40.867761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:40.872052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:40.999121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:41.007258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a310976-a7ff-47fc-bf22-c175daa61abe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153604 Sep 13 16:10:41.007812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 244/494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:42.030007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:42.030543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:42.037117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:42.037594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:42.038028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:42.038702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:42.039195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:42.039620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:42.175791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:42.184315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9bdea2c1-e0d2-421a-adf2-607a7fc80644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.158108 Sep 13 16:10:42.197768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 251/495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:43.208075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:43.208623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:43.216015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:43.216495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:43.216927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:43.217618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:43.218068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:43.218490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:43.357643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:43.366258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54df0b30-63e1-45cb-b73e-d9a3f3e20d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.162120 Sep 13 16:10:43.366810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 245/496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:44.389687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:44.390293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:44.397349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:44.397825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:44.398254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:44.398981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:44.399437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:44.399855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:44.529650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:44.538988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4028396d-d2c2-4de7-8e7e-daea1939ef6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153308 Sep 13 16:10:44.539542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 252/497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:45.563116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:45.563729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:45.570802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:45.571320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:45.571755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:45.572440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:45.572894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:45.573325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:45.700023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:45.708455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a48ddd7-1eb7-4389-b26e-fecfcea19d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149145 Sep 13 16:10:45.709023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 246/498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:46.731755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:46.732362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:46.738773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:46.739282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:46.739716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:46.740397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:46.740846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:46.741267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:46.872033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:46.880999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c26984f-4b9e-49df-a332-cd54a6d3198e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153073 Sep 13 16:10:46.881567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 253/499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:47.905207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:47.905846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:47.908393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:10:47.915391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:47.915896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:47.916328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:47.917012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:47.917460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:47.917881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:48.046677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:48.054968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdcb825a-ef34-4cd1-9d3d-e648ef615de2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153531 Sep 13 16:10:48.055530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 247/500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:49.077389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:49.077995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:49.084963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:49.085471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:49.085906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:49.086582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:49.087059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:49.087480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:49.216612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:49.225124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6cc156a-54eb-4a02-9874-01958bf6fa43 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151539 Sep 13 16:10:49.225697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 254/501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:50.248593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:50.249208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:50.255819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:50.256303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:50.256747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:50.257439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:50.257896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:50.258325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:50.390053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:50.398231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea4af25e-c055-4835-a73b-dbf0f675fdc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153798 Sep 13 16:10:50.398793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 248/502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:51.421128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:51.421732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:51.428281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:51.428763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:51.429195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:51.429885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:51.430350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:51.430759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:51.555695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:51.563801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7448253d-1a59-40e4-a5c6-8b25f61e19be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146650 Sep 13 16:10:51.564365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 255/503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:52.587616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:52.589239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:52.595174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:52.595653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:52.596743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:52.597440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:52.597925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:52.598499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:52.729213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:52.737320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3f4a541-0a77-4624-96b6-fdc12d5426ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153709 Sep 13 16:10:52.737881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 249/504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:53.761389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:53.761987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:53.769391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:53.769881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:53.770319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:53.771038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:53.771493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:53.771916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:53.899354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:53.907419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6237ad90-4098-4d1c-a0df-293ff7fa9300 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149932 Sep 13 16:10:53.907975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 256/505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:54.930466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:54.931106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:54.937485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:54.937975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:54.938441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:54.939156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:54.939608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:54.940029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:55.073211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:55.082229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4aae9aa3-51d5-4f5b-8017-b6c9f8b4b439 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154735 Sep 13 16:10:55.082788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 250/506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:56.105227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:56.105840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:56.112559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:56.113046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:56.113490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:56.114184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:56.114639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:56.115105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:56.246438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:56.254482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d4f356a-ba1e-4030-9763-bd1e1f09db59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153116 Sep 13 16:10:56.255060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 257/507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:57.278671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:57.279200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:57.286315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:57.286796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:57.287260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:57.287945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:57.288391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:57.288835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:57.417007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:57.426079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6fe6089-2523-4819-a828-2c969ab9746a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151072 Sep 13 16:10:57.426647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 251/508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:58.448816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:58.449421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:58.456272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:58.456766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:58.457203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:58.457883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:58.458331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:58.458946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:58.588281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:58.596445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcd076e6-8aa8-4e48-9a53-21a3fa1cb91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151395 Sep 13 16:10:58.597336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 258/509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:10:59.620915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:10:59.621527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:10:59.628631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:59.629112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:59.629554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:59.630245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:10:59.630699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:10:59.631159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:10:59.757325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:10:59.765525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e32191d-b3c0-4fd7-9850-05380ab1eab4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148730 Sep 13 16:10:59.766087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 252/510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:10:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:00.789872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:00.790475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:00.796825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:00.797350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:00.797992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:00.799052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:00.799855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:00.800604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:00.931339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:00.939333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cef93a1a-e316-431e-b150-7581b7007e8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153240 Sep 13 16:11:00.940516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 259/511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:01.962856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:01.963484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:01.969813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:01.970285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:01.970714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:01.975972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:01.976426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:01.976852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:02.106278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:02.114403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eafd6315-f28d-47a7-bee6-5d830c20ca64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.155450 Sep 13 16:11:02.114993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 253/512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:03.137343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:03.138005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:03.140446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=34 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:03.146782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:03.147288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:03.147719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:03.148404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:03.148851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:03.149269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:03.152007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=92 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:03.278850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:03.287522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b086759d-ab89-43b5-985f-3a7488b1ced7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153967 Sep 13 16:11:03.288080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 260/513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:04.310963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:04.311601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:04.318142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:04.318572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:04.319043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:04.319734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:04.320186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:04.320615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:04.453936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:04.462966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0ff7e35-fbff-40fe-9de7-e69bff66fad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.155805 Sep 13 16:11:04.463683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 254/514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:05.488571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:05.489173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:05.495910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:05.496392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:05.496825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:05.497523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:05.497969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:05.498474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:05.625780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:05.633884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3731bb57-8072-42d3-9bd0-36961869aec7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150236 Sep 13 16:11:05.634439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 261/515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:06.277827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:06.278390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:06.284993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.285471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.285901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.286585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.287052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.287470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.315745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e4dc406-e15e-450d-be0c-ebf2b0fbeb9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments/656b3fed-cddb-42a2-899b-542b2abf3e0d" status: 200 len: 194 microversion: 2.20 time: 0.041821 Sep 13 16:11:06.316243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 255/516] 10.222.0.50 () {60 vars in 1454 bytes} [Tue Sep 13 16:11:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments/656b3fed-cddb-42a2-899b-542b2abf3e0d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:06.385323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:06.385947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:06.391860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.392928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.393422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.394095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.394561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.394991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.515799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lazy-loading 'services' on Instance uuid 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:11:06.631736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66f7a283-16b2-4d75-af56-894988e8967b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments/656b3fed-cddb-42a2-899b-542b2abf3e0d" status: 202 len: 0 microversion: 2.20 time: 0.250154 Sep 13 16:11:06.632310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 262/517] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Sep 13 16:11:06 2022] DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments/656b3fed-cddb-42a2-899b-542b2abf3e0d => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:11:06.640585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:06.643554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:06.649386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.649874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.651813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.651813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.651813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.652202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.657372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:06.658671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:06.664980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.665470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.666399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.667245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:06.667614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:06.668026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:06.684195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e89df193-380a-4873-a354-1edd72e59b6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047466 Sep 13 16:11:06.684753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 256/518] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:06.798567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:06.807482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-051a12e6-964e-4349-9976-fae8a8f900d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154216 Sep 13 16:11:06.808046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 263/519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:07.696936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:07.699093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:07.706096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:07.706570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:07.707031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:07.707718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:07.708172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:07.708596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:07.737868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d299f979-8d88-4b1d-bbeb-e48fa01a1653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044899 Sep 13 16:11:07.738419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 257/520] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:07.831072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:07.831692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:07.838016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:07.838499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:07.838967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:07.839658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:07.840111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:07.840545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:07.968374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:07.976577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf993efb-a7de-40d1-8eff-60327caedb60 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150087 Sep 13 16:11:07.977134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 264/521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:08.749859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:08.752023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:08.758256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:08.758730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:08.759201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:08.759881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:08.760328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:08.760747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:08.789931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8517f6d5-06f9-421d-9196-27e89a48892a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043998 Sep 13 16:11:08.790465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 258/522] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:08.999689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:09.000235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:09.006571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:09.007158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:09.007599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:09.008283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:09.008737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:09.009161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:09.134635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:09.143506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-63261a12-989e-464b-b0fa-e3b88503c27e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147731 Sep 13 16:11:09.144061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 265/523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:09.803530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:09.805731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:09.812044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:09.812557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:09.812996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:09.813684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:09.814737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:09.815191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:09.843435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-570c07be-1817-4b40-9420-9ae421d2e906 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045166 Sep 13 16:11:09.844136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 259/524] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:10.167365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:10.167974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:10.174688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:10.175189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:10.175627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:10.176312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:10.176762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:10.177198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:10.310256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:10.318377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da15ae33-bc0d-4f45-9ab1-68e486ec033a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.155035 Sep 13 16:11:10.318871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 266/525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:10.856014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:10.858163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:10.864535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:10.865009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:10.865438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:10.866117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:10.866564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:10.867015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:10.893826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:10.898962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-212fa231-d25a-4d6c-97ff-3beca7642cdc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046914 Sep 13 16:11:10.899506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 260/526] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:11.341979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:11.342584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:11.349010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:11.349488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:11.349919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:11.350590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:11.351069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:11.351488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:11.477595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:11.486332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-499b3bbf-35fd-4c20-981b-7f15ef2d1cfc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147498 Sep 13 16:11:11.486912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 267/527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:11.911841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:11.914038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:11.920261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:11.920743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:11.921173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:11.921858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:11.922310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:11.922736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:11.951345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4cf3351c-9864-4d82-835d-0e3d37085ce0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044229 Sep 13 16:11:11.951885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 261/528] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:12.509967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:12.510488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:12.517546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.518056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.518472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.519190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.519642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.520079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.647543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:12.655568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcd7c331-621a-4215-a47b-75faa0f4cc11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149562 Sep 13 16:11:12.656129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 268/529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:12.828952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:12.829526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:12.835709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.836192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.836624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.837308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.837758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.838182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.861119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e3ea62d-bd57-4c47-9fc7-93d9d3e8fc7e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/ips" status: 200 len: 150 microversion: 2.1 time: 0.035478 Sep 13 16:11:12.861911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 262/530] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:11:12 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:12.873743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a788e0d-23d3-4768-8cd6-ce705e349002"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:11:12.876871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:12.882855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.883374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.883984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.884671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.885121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.885540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.964210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:12.964708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Invalid volume: volume 0a788e0d-23d3-4768-8cd6-ce705e349002 is already attached to instances: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/os-volume_attachments HTTP/1.1 Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 74 Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:11:12.966265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {"volumeAttachment": {"volumeId": "0a788e0d-23d3-4768-8cd6-ce705e349002"}} Sep 13 16:11:12.967811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Invalid volume: volume 0a788e0d-23d3-4768-8cd6-ce705e349002 is already attached to instances: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '8f346b6b-2791-48f9-be20-2c8defa26b50', 'body': {'volumeAttachment': {'volumeId': '0a788e0d-23d3-4768-8cd6-ce705e349002'}}} Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a788e0d-23d3-4768-8cd6-ce705e349002 is already attached to instances: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:12.968560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a788e0d-23d3-4768-8cd6-ce705e349002 is already attached to instances: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:12.970256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:11:12.972107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:11:12.972107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:11:12.972107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:11:12.972107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a788e0d-23d3-4768-8cd6-ce705e349002 is already attached to instances: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd Sep 13 16:11:12.972107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:12.972488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:12.972591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 400 to user: Invalid volume: volume 0a788e0d-23d3-4768-8cd6-ce705e349002 is already attached to instances: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:11:12.972591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-adbd9e60-a623-4da8-8c60-37bc15e3eb4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098083 Sep 13 16:11:12.972591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 269/531] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:11:12 2022] POST /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:11:12.974524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.975047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.975485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.976182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.976633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.976736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:12.977056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.977207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:12.983588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.984066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.984493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:12.985172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:12.986209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:12.986813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:13.007010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-416e6a95-c27f-430f-b900-395146eb049c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046630 Sep 13 16:11:13.007566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 263/532] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:13.012904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:11:13.098771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18e989ff-d463-40f5-bb64-ece8be0a4b0e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 204 len: 0 microversion: 2.1 time: 0.125472 Sep 13 16:11:13.099333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 270/533] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:11:12 2022] DELETE /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:11:13.107579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:13.108194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:13.114882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:13.115393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:13.115833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:13.116525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:13.116978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:13.117406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:13.242386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:13.250228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e729780f-f083-40a9-b24c-e2e7d3e23632 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.146459 Sep 13 16:11:13.250782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 264/534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:13 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:13.679458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:13.680155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:13.686547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:13.687066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:13.687510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:13.688195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:13.689436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:13.689864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:13.820376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:13.828833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b0ebd21c-0c45-4fac-8c62-d5b656b96536 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153593 Sep 13 16:11:13.830128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 271/535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:14.020230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:14.022424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:14.028729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:14.029211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:14.029649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:14.030338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:14.030789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:14.031246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:14.061046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2dacb0ae-2a12-40c6-abe1-8b49ee298f32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045342 Sep 13 16:11:14.061614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 265/536] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:14.275616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:14.276145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:14.282149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:14.283245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:14.283675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:14.284346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:14.284790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:14.285201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:14.414791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:14.422348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5d0e465-1b1f-4206-b0fb-76eeffcd5196 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.150620 Sep 13 16:11:14.422952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 272/537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:14 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:14.852443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:14.853061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:14.859206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:14.859693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:14.860654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:14.861350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:14.861801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:14.862229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:14.987399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:14.995930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74a7769b-2abf-4589-b449-cf7a382fdfa7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147364 Sep 13 16:11:14.996497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 266/538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:15.073200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:15.075490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:15.081944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:15.082427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:15.082868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:15.083585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:15.084035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:15.084460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:15.115033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7872ca1b-f499-49d4-8767-1c37683b59e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045670 Sep 13 16:11:15.115581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 273/539] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:15.445570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:15.446184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:15.452557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:15.453035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:15.453468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:15.454798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:15.455359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:15.455781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:15.583783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:15.591381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c692eec-f7ab-4218-b1a1-af11ad95eb8f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.149676 Sep 13 16:11:15.591948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 267/540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:15 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:16.020306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:16.020961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:16.026919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:16.027406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:16.027889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:16.028517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:16.028964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:16.029384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:16.046859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:16.128002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:16.130139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:16.136126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:16.136610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:16.137049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:16.137750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:16.138207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:16.138634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:16.164751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:16.169076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5914e41-dc9f-4bd6-a499-0be82d6591ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045295 Sep 13 16:11:16.169642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 268/541] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:16.173723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-23fefc70-cc9c-48c7-9831-83804cae7c21 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.157366 Sep 13 16:11:16.174276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 274/542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:16.614173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:16.614777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:16.621568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:16.622047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:16.622482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:16.623192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:16.623643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:16.624067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:16.752978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:16.760610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4648d2d-1608-4d5b-b50a-cd43382e57ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.150283 Sep 13 16:11:16.761164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 269/543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:16 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:17.181590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:17.183758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:17.190886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:17.191388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:17.192078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:17.192772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:17.193225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:17.193648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:17.196585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:17.197192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:17.203148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:17.203710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:17.204673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:17.205359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:17.206148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:17.206573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:17.222698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-231117a8-fd64-4c6e-bd7b-19ea5d295667 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Sep 13 16:11:17.223337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 275/544] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:17.331770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:17.339834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d126f08-0d8e-40de-9e54-1a0ff1d9b20f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147059 Sep 13 16:11:17.340604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 270/545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:11:17.784579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:17.785129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:17.791025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:17.791509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:17.791944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:17.792621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:17.793071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:17.793493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:17.919489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:17.927666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80cf2596-cd00-4451-8fd5-82747e3bd646 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.147017 Sep 13 16:11:17.928229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 276/546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:17 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:18.235939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:18.238056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:18.240366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=48 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:18.245701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:18.246178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:18.246613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:18.247331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:18.247782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:18.248206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:18.277212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a753ec1-271b-4ff4-a1d5-c94bc8ee37e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045861 Sep 13 16:11:18.277763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 271/547] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:18.363836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:18.364463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:18.371148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:18.371621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:18.372051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:18.372728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:18.373174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:18.373593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:18.503618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:18.511836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-316f915e-70ba-4176-b1a8-2de48dcc7201 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152316 Sep 13 16:11:18.512396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 277/548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:18.951627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:18.952234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:18.958043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:18.958526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:18.959004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:18.959718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:18.960157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:18.960582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:19.086421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:19.094831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4673ceb-602c-4fb5-ad66-eb1c03c51e9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.146485 Sep 13 16:11:19.095488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 272/549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:18 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:19.289588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:19.291716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:19.297708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:19.298182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:19.298611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:19.299323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:19.299793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:19.300210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:19.328994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b71e67d-4ea4-4717-875d-30bcc5bd2a94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042779 Sep 13 16:11:19.329577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 278/550] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:19.536036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:19.536586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:19.542965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:19.543455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:19.543898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:19.544589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:19.545047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:19.545481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:19.673484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:19.681615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f0ffefe-3e7a-4dea-9149-bdb653fd9c8a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150061 Sep 13 16:11:19.682176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 273/551] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:20.119643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:20.120248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:20.127740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:20.128213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:20.128643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:20.129321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:20.129763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:20.130180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:20.261651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:20.269725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e08ff40b-589d-45cc-a4bc-b64bef4058b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.154135 Sep 13 16:11:20.270283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 279/552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:20 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:20.341323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:20.343447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:20.353980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:20.354462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:20.354912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:20.355597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:20.356044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:20.356460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:20.386097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f32bdc3-cdeb-45dc-87f0-8a7dec07f6dc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048677 Sep 13 16:11:20.386648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 274/553] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:20.705091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:20.705694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:20.711609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:20.712080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:20.712533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:20.713202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:20.713647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:20.714062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:20.843746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:20.852651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ddb8786-6c7a-455c-bc12-59b95f9ac08c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151440 Sep 13 16:11:20.853208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 280/554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:21.292620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:21.293227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:21.299669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:21.300143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:21.300576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:21.301262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:21.301712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:21.302135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:21.398568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:21.400872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:21.407238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:21.407727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:21.408166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:21.408854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:21.409309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:21.409733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:21.434349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:21.440232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c49f16f0-10de-4202-8a91-8c37a5fb1494 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045820 Sep 13 16:11:21.440799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 281/555] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:21.443682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6397404-88a6-468f-b825-d9dc8decba45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.154845 Sep 13 16:11:21.444331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 275/556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:21 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:21.877113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:21.877722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:21.883588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:21.884064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:21.884493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:21.885167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:21.885610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:21.886027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:22.012892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:22.021043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f0f9bfba-f2af-4d6c-a482-2de633d4227e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148798 Sep 13 16:11:22.021604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 282/557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:22.452578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:22.454748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:22.461406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:22.461927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:22.462365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:22.463246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:22.463713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:22.464144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:22.468647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:22.470098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:22.476853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:22.477406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:22.477840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:22.478526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:22.479000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:22.479419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:22.494571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa62fc6a-61ca-4ea3-875e-ffb789e60370 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045876 Sep 13 16:11:22.495157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 276/558] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:22.610515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:22.618335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ed9e6c1-5703-4a51-b51b-2fec6112635b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.153245 Sep 13 16:11:22.618890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 283/559] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:22 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:11:23.044406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:23.045016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:23.051319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:23.051806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:23.052242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:23.052933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:23.053389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:23.053818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:23.178551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:23.182014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:23.187609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac2d0520-a64a-4c87-848b-f81c1f778cbe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147015 Sep 13 16:11:23.188172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 277/560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:23.507101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:23.509234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:23.516317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:23.516843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:23.517253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:23.517938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:23.518387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:23.518804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:23.548355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-23abd16d-2cc0-4f9d-8501-bcc93909e50d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045231 Sep 13 16:11:23.548891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 284/561] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:23.642519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:23.643161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:23.649744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:23.650228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:23.650670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:23.651401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:23.651857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:23.652289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:23.787077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:23.794634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40be0c1c-f83e-4209-956b-45c5506926c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.155932 Sep 13 16:11:23.795236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 278/562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:23 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:24.211750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:24.212363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:24.218253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:24.219001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:24.219557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:24.220243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:24.220694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:24.221118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:24.345981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:24.354804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5340757-c854-4ce7-a613-43294e81811d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146763 Sep 13 16:11:24.355644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 285/563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:24.561210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:24.563979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:24.569827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:24.570308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:24.570745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:24.571460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:24.571915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:24.572340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:24.602427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a552deb7-184d-4596-96dd-2c1130a375de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045249 Sep 13 16:11:24.602998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 279/564] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:24.818845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:24.819417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:24.825785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:24.826271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:24.826707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:24.827433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:24.827897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:24.828330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:24.964131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:24.972691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96540da3-0f58-4faa-bcab-0b3ac29faa99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.157709 Sep 13 16:11:24.973476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 286/565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:24 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:25.378308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:25.378934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:25.385351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:25.385826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:25.386261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:25.386962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:25.387414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:25.387839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:25.518029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:25.526112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4d09fefc-083c-4e1d-9b65-db47cf1add75 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151676 Sep 13 16:11:25.526662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 280/566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:25.615029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:25.617136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:25.623205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:25.623683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:25.624107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:25.624867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:25.625314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:25.625727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:25.654824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d57aa7f-994c-444a-b819-4b0cd06eef3e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043666 Sep 13 16:11:25.655413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 287/567] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:25.997444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:25.998004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:26.004536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:26.005015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:26.005447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:26.006128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:26.006578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:26.007034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:26.132913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:26.140986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62c0760f-76f3-4757-b50e-d1871022979d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.147111 Sep 13 16:11:26.141385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 281/568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:25 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:26.553603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:26.554208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:26.560608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:26.561082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:26.561514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:26.562197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:26.562800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:26.563248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:26.677080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:26.680284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:26.688218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:26.688957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:26.689352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:26.690139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:26.690667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:26.691190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:26.725080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5835275c-7d75-48cf-864c-ce8242272d3c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060954 Sep 13 16:11:26.725772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 282/569] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:26.913115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:26.921233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9494aa49-d1d1-4d57-a6bc-070600e3529b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.371444 Sep 13 16:11:26.921798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 288/570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:27.164216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:27.164756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:27.170649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:27.171171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:27.171618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:27.172296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:27.172742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:27.173161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:27.298282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:27.306176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-09cc21d8-dd2b-4162-b592-003fa0f26d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.145863 Sep 13 16:11:27.306739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 283/571] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:27 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:27.737663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:27.739897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:27.746622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:27.747137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:27.747575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:27.748259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:27.748707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:27.749128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:27.778851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6502e871-0ecc-4bdf-93e6-5f7efa8d3d9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045189 Sep 13 16:11:27.779420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 289/572] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:27.944411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:27.945017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:27.951470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:27.951948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:27.953044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:27.953748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:27.954195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:27.954613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:28.085027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:28.093172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c06f8f38-8027-4c56-bd70-803869a01d8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152623 Sep 13 16:11:28.093738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 284/573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:28.329883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:28.330488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:28.336618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:28.337095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:28.337527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:28.338203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:28.338650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:28.339102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:28.462201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:28.469790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ddcbc63-e290-407b-82ea-38db6b2c096e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.143832 Sep 13 16:11:28.470367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 290/574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:28 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:28.791927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:28.794044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:28.800646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:28.801148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:28.801657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:28.802368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:28.802935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:28.803337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:28.832612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22540f1f-39a9-465c-b63e-eb35dd3d83ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044558 Sep 13 16:11:28.833147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 285/575] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:29.116566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:29.117178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:29.123773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:29.124253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:29.124688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:29.125369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:29.125970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:29.126417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:29.130254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:29.254736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:29.262949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c601ada-cd30-4d80-8c2c-fc34c34a8a07 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150213 Sep 13 16:11:29.263514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 291/576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:29.494011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:29.494643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:29.500587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:29.501660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:29.502099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:29.502784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:29.503266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:29.503692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:29.631617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:29.639180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d0492a9-562b-4df7-ac1e-cba5f5d91238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.149403 Sep 13 16:11:29.639736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 286/577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:29 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:29.846170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:29.848389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:29.854386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:29.854873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:29.855342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:29.856040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:29.856493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:29.856919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:29.888259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12469c0d-de3b-4bf7-8acf-8c0c6b665215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047243 Sep 13 16:11:29.888820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 292/578] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:30.287320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:30.287926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:30.294187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:30.294667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:30.295135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:30.295828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:30.296279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:30.296705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:30.421897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:30.430640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31b83cd7-b471-4142-b0f1-0a28e30826d2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147187 Sep 13 16:11:30.431164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 287/579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:30.663810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:30.664505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:30.671265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:30.671757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:30.672195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:30.672896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:30.673360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:30.673794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:30.817477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:30.825103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c9b0048-39ff-45c5-8e23-de6a6320341b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.165124 Sep 13 16:11:30.825662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 293/580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:30 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:30.900937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:30.903095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:30.909430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:30.909907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:30.910366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:30.911085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:30.911532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:30.911952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:30.941424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-132036b5-017c-4152-bd93-bcb4b7af4c69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044324 Sep 13 16:11:30.941974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 288/581] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:31.452717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:31.453328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:31.459543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:31.460026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:31.460457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:31.461218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:31.461667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:31.462086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:31.588293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:31.596647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b880a0e2-06d4-402e-8338-c801fc6a6c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147740 Sep 13 16:11:31.597207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 294/582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:31.851145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:31.852062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:31.857971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:31.858451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:31.858927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:31.859673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:31.860713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:31.861165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:31.953931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:31.956461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:31.964110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:31.964673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:31.965388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:31.965958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:31.966473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:31.966993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:32.000948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-72a3806f-484b-45da-8e70-e8111b8ce1d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050743 Sep 13 16:11:32.002019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 295/583] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:32.054705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:32.065845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f602cfa2-805d-4fd9-a442-3b132b7629d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.219694 Sep 13 16:11:32.066615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 289/584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:31 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:32.620002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:32.620604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:32.626424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:32.627675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:32.628279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:32.628960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:32.629409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:32.629830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:32.765457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:32.773664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbb31957-8577-4cfd-90a2-a072a1ff7055 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.157832 Sep 13 16:11:32.774226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 296/585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:33.013523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:33.015597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:33.022400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:33.022876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:33.023337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:33.024024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:33.024474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:33.024898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:33.056349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c126704-f0c4-47b0-a330-7ed75096c730 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046758 Sep 13 16:11:33.057202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 290/586] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:33.091151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:33.091767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:33.098569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:33.099087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:33.099534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:33.100223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:33.100676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:33.101101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:33.225680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:33.233187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9121ff1a-c550-4e31-aa7c-16f16707516d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1681 microversion: 2.1 time: 0.145916 Sep 13 16:11:33.233751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 297/587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:33 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:33.797164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:33.797384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:33.803692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:33.804175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:33.804958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:33.805301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:33.805743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:33.806163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:34.010361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:34.020155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5839f3fe-1544-4c90-9032-d3fe6d0deefa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.227336 Sep 13 16:11:34.020855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 291/588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:34.070087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:34.072474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:34.074339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:34.080861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:34.081363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:34.081800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:34.082495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:34.082973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:34.083400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:34.115383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-72beb24d-21c9-4607-be14-c893a296b29d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049202 Sep 13 16:11:34.116018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 298/589] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:34.257785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:34.259136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:34.266427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:34.267306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:34.267761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:34.268474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:34.268928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:34.269353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:34.279764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-9c665894-e9c1-48ae-b51c-2acfbf5ecb58 req-64dc4f1c-b43e-435b-b657-ea66c65ddc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f346b6b-2791-48f9-be20-2c8defa26b50", "name": "network-vif-deleted", "tag": "c13b562b-381d-44e3-ac35-611b6c7cd637"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:11:34.292594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-9c665894-e9c1-48ae-b51c-2acfbf5ecb58 req-64dc4f1c-b43e-435b-b657-ea66c65ddc2c service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:34.293938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-9c665894-e9c1-48ae-b51c-2acfbf5ecb58 req-64dc4f1c-b43e-435b-b657-ea66c65ddc2c service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:34.294884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-9c665894-e9c1-48ae-b51c-2acfbf5ecb58 req-64dc4f1c-b43e-435b-b657-ea66c65ddc2c service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:34.309703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-9c665894-e9c1-48ae-b51c-2acfbf5ecb58 req-64dc4f1c-b43e-435b-b657-ea66c65ddc2c service nova] Creating event network-vif-deleted:c13b562b-381d-44e3-ac35-611b6c7cd637 for instance 8f346b6b-2791-48f9-be20-2c8defa26b50 on hv-cinder-82002 Sep 13 16:11:34.319320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-9c665894-e9c1-48ae-b51c-2acfbf5ecb58 req-64dc4f1c-b43e-435b-b657-ea66c65ddc2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043077 Sep 13 16:11:34.320228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 299/590] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:34.333693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:34.343283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cbe12641-c8d6-4c6d-a7d7-0e632fe1d6f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1614 microversion: 2.1 time: 0.089208 Sep 13 16:11:34.344411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 292/591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:34 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:35.044153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:35.045214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:35.051857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.052471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.052970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.053767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.054383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.055455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.128599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:35.131196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:35.143862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.144882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.146035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.148816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.150642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.152635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.220636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-252464dd-7364-47f1-8125-26615cb6fb56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090940 Sep 13 16:11:35.228865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 293/592] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:35.278587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:35.287635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9ec30ec-6a6d-49dc-8a8b-6191c5449856 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1713 microversion: 2.1 time: 0.247697 Sep 13 16:11:35.288211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 300/593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1713 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:35.370695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:35.371362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:35.383783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.384288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.384733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.385453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.385911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.386342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.431835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:35.459384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:35.460134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:35.468758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.469435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.469885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.470855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lazy-loading 'fault' on Instance uuid 8f346b6b-2791-48f9-be20-2c8defa26b50 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:11:35.472794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.473494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.473919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.474625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.475112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.475545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.537609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:35.546512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7cc0856-72b5-4fa2-b6df-07da75e685ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 200 len: 1331 microversion: 2.1 time: 0.180742 Sep 13 16:11:35.562158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 294/594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:35 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:35.582888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f while it is in vm_state rescued Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Request method failure captured: Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments/f285f277-588c-47f2-a0c3-7c605acf3904 HTTP/1.1 Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKquW9FPzA91u_gO_OM_eeWoJaatE8b1iQ9x6o0TlAVBkMLDN6sWT_dRsTvpAp68FOuTvOEzmkhGiaaEqsBPwk_NbYkfBtEhI6xZRktvSgflCo6rs1tuTtY9mKEZ7t464omn-EQ-AK4F3_bvEXAA2Ba179oSmmRIlA2FeEZGmMqMbDo Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:11:35.584798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b11b198b8754bcabf244e0047475b8d"}]}] Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 6d31b2ec391441f7bab3546d2354b0a1 Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:11:35.586058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Cannot 'detach_volume' instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f while it is in vm_state rescued Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '7a8e8d08-fc78-4837-8f60-1ba9a1855c8f', 'id': 'f285f277-588c-47f2-a0c3-7c605acf3904'} Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:11:35.586794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f while it is in vm_state rescued Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f while it is in vm_state rescued Sep 13 16:11:35.587977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:35.590395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Returning 409 to user: Cannot 'detach_volume' instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f while it is in vm_state rescued {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:11:35.592314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e26b2186-1b29-40f6-9354-0dc217a7938f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments/f285f277-588c-47f2-a0c3-7c605acf3904" status: 409 len: 152 microversion: 2.1 time: 0.137735 Sep 13 16:11:35.593746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 301/595] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:11:35 2022] DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments/f285f277-588c-47f2-a0c3-7c605acf3904 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:11:35.604073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:11:35.604963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:35.613033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.613537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.613980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.614704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.615191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.615803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.691835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed03f238-d726-4b08-aa18-2ccc37089411 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.092967 Sep 13 16:11:35.695906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 295/596] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:11:35 2022] POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:11:35.703994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:35.705606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:35.714320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.714820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.715316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.716028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:35.716484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:35.716946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:35.870264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:35.888140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1be09fa-c894-4bf3-bd6a-17f559258945 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1721 microversion: 2.1 time: 0.189743 Sep 13 16:11:35.889849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 302/597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:36.239541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:36.243168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:36.252102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:36.252817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:36.253529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:36.254568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:36.256021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:36.257119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:36.297221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7dbacd42-6a57-4309-b4d1-df0d12f46fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066450 Sep 13 16:11:36.297958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 296/598] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:36.573684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:36.574559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:36.581784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:36.582379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:36.582881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:36.583681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:36.584215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:36.584707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:36.601154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 HTTP/1.1 Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:11:36.603055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:11:36.604393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '8f346b6b-2791-48f9-be20-2c8defa26b50'} Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:11:36.605139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:11:36.606307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:11:36.607674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:11:36.607674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52bcd884-4c81-424b-bd4e-1c3ffbb8f232 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 404 len: 111 microversion: 2.1 time: 0.035117 Sep 13 16:11:36.607674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 303/599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:36 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:11:36.614704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b6bd98e-b9fd-4902-90f9-5edea05222c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '.version_select at 0x7fb67c3104c0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:36.644430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b6bd98e-b9fd-4902-90f9-5edea05222c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900529941" status: 202 len: 0 microversion: 2.1 time: 0.034464 Sep 13 16:11:36.648529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 297/600] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Sep 13 16:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900529941 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:11:36.913684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:36.914315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:36.920553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:36.921117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:36.921652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:36.922423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:36.923020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:36.923520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.123017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:37.132545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cec76f2-6b0e-49f4-ba32-62e6c0905b82 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1721 microversion: 2.1 time: 0.222803 Sep 13 16:11:37.133114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 304/601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:37.312406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:37.315684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:37.322721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:37.323317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:37.323826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.324599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:37.325627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:37.326063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.361055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-271d2748-cb8b-4748-82d3-b2fa1c732169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053800 Sep 13 16:11:37.365820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 298/602] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:37.421339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:37.421839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:37.427774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:37.428252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:37.428706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.429393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:37.429843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:37.430267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.507965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lazy-loading 'services' on Instance uuid 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:11:37.576879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5d05e43-263f-4131-b78c-c607cae7c1d1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments/0a788e0d-23d3-4768-8cd6-ce705e349002" status: 202 len: 0 microversion: 2.1 time: 0.159163 Sep 13 16:11:37.577513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 305/603] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:11:37 2022] DELETE /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments/0a788e0d-23d3-4768-8cd6-ce705e349002 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:11:37.586406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:37.588560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:37.594304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:37.595423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:37.596128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.596812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:37.597259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:37.597678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:37.626884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28200f95-a612-4396-8429-e5fa1cbdae48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Sep 13 16:11:37.627615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 299/604] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:38.162608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:38.163332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:38.169345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:38.169834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:38.170271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:38.170982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:38.171437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:38.171914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:38.303180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:38.311698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0bd266b-59ed-44e4-a1fa-4091fa5ca613 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1721 microversion: 2.1 time: 0.153725 Sep 13 16:11:38.312263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 306/605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:38.373879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:38.376669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:38.382705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:38.383221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:38.383657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:38.384350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:38.384804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:38.385227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:38.416037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-763c4e11-b3a1-4eec-9553-260d7ee5b582 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046148 Sep 13 16:11:38.416588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 300/606] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:38.639593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:38.642466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:38.648583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:38.649058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:38.649486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:38.650160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:38.650604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:38.651052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:38.679813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbf3e04f-4502-4c7b-b0b5-aad289b11f60 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Sep 13 16:11:38.680351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 307/607] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:39.335673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:39.336317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:39.342708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.343224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.343660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.344343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.345547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.345978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.429224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:39.431598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:39.439636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.440223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.440737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.441516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.442052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.442543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.457579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:39.476448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f148aaa-22cb-483e-b8bd-e5751f2fd93e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051557 Sep 13 16:11:39.477690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 308/608] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:39.479520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:11:39.488084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf89c5cc-ed3f-4ca0-b2d3-9ddf3524f3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1727 microversion: 2.1 time: 0.156240 Sep 13 16:11:39.488643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 301/609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:11:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:11:39.510944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:39.511447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:39.517926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.518412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.518851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.519561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.520020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.520447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.595714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9bcc01ce-f094-4408-bf06-1ce1044a818f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087546 Sep 13 16:11:39.596318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 309/610] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:11:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:39.692606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:39.694868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:39.700666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.701145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.701577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.702257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:39.702705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:39.703152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:39.733874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cfd03d92-fb5d-4696-83c5-a60fae5e1748 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Sep 13 16:11:39.734427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 302/611] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:40.473415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-b9f3147b-d5fe-48c9-9dd7-7eab81f45859 req-ecd98137-eb83-4357-8367-4827b1f51380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:11:40.483567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b9f3147b-d5fe-48c9-9dd7-7eab81f45859 req-ecd98137-eb83-4357-8367-4827b1f51380 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:40.484130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b9f3147b-d5fe-48c9-9dd7-7eab81f45859 req-ecd98137-eb83-4357-8367-4827b1f51380 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:40.484652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b9f3147b-d5fe-48c9-9dd7-7eab81f45859 req-ecd98137-eb83-4357-8367-4827b1f51380 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:40.488460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:40.490705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:40.497586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:40.498081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-b9f3147b-d5fe-48c9-9dd7-7eab81f45859 req-ecd98137-eb83-4357-8367-4827b1f51380 service nova] Creating event network-changed:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:11:40.498184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:40.498499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:40.499223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:40.499679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:40.500105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:40.503971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-b9f3147b-d5fe-48c9-9dd7-7eab81f45859 req-ecd98137-eb83-4357-8367-4827b1f51380 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035843 Sep 13 16:11:40.505223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 310/612] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:40.559532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-579c1ede-8310-4571-a0d9-8fbb7457fd86 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072878 Sep 13 16:11:40.563046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 303/613] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:40.746660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:40.749207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:40.756208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:40.756693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:40.757349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:40.758062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:40.758491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:40.759122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:40.789243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86e891f4-c74e-456a-a591-245e1b40ce27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047077 Sep 13 16:11:40.790452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 311/614] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:41.570316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:41.572492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:41.579422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:41.580172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:41.580887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:41.582028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:41.582787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:41.583645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:41.637358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df8ef188-e304-4428-8141-3f125575ecca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070990 Sep 13 16:11:41.637921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 304/615] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:41.803271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:41.805743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:41.812215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:41.812688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:41.813849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:41.814556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:41.815110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:41.815479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:41.843962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85398611-7b53-424d-97bc-c6dcfbdba3c8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046253 Sep 13 16:11:41.844590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 312/616] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:42.519994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-dbc3550c-b00d-43a4-b8b0-44e4b6d12dbb req-09d7dec6-818c-4208-924e-f750d13c11b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:11:42.529051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-dbc3550c-b00d-43a4-b8b0-44e4b6d12dbb req-09d7dec6-818c-4208-924e-f750d13c11b7 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:42.529515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-dbc3550c-b00d-43a4-b8b0-44e4b6d12dbb req-09d7dec6-818c-4208-924e-f750d13c11b7 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:42.529937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-dbc3550c-b00d-43a4-b8b0-44e4b6d12dbb req-09d7dec6-818c-4208-924e-f750d13c11b7 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:42.541245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-dbc3550c-b00d-43a4-b8b0-44e4b6d12dbb req-09d7dec6-818c-4208-924e-f750d13c11b7 service nova] Creating event network-changed:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:11:42.546024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-dbc3550c-b00d-43a4-b8b0-44e4b6d12dbb req-09d7dec6-818c-4208-924e-f750d13c11b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030223 Sep 13 16:11:42.546589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 305/617] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:42.650180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:42.652221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:42.658785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:42.659298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:42.659734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:42.660422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:42.660993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:42.661474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:42.705155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8bc6a1e-f05b-42f8-9efc-2a835dae08ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059453 Sep 13 16:11:42.705990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 313/618] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:42.857662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:42.860143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:42.866316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:42.867100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:42.867589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:42.868216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:42.868669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:42.869093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:42.900080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6862d4da-ec40-4361-855b-ba66fba060e5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Sep 13 16:11:42.900647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 306/619] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:43.717809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:43.720052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:43.726431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:43.726945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:43.727387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:43.728082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:43.728535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:43.728964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:43.759173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2dcc2fbf-aef5-42a1-bad7-eae999542a67 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045404 Sep 13 16:11:43.759769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 314/620] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:43.912485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:43.914838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:43.921262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:43.921736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:43.922183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:43.923019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:43.923462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:43.923884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:43.952437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a50cede8-23ed-4e00-b5cc-2619127338e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Sep 13 16:11:43.952908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 307/621] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:44.773255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:44.775429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:44.782404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:44.783027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:44.783376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:44.784105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:44.784529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:44.784956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:44.815860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22fe102a-efb3-42f1-b27f-15282cb4f187 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046530 Sep 13 16:11:44.816582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 315/622] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:44.965438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:44.967576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:44.974009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:44.974481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:44.974936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:44.975618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:44.976065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:44.976487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:45.007327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a18c089-bc02-4f03-9b08-52c0734397ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Sep 13 16:11:45.007792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 308/623] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:45.829294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:45.831485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:45.837865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:45.838345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:45.838778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:45.839495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:45.839946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:45.840370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:45.874641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-517a5c38-46a3-4c29-91ff-39edcba2eb5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049800 Sep 13 16:11:45.875999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 316/624] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:46.019911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:46.022054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:46.028426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:46.028878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:46.029306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:46.029981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:46.030425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:46.030846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:46.059362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27e336bf-6c71-4b5e-bd82-1e0131b2ec73 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Sep 13 16:11:46.059917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 309/625] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:46.887764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:46.889931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:46.896441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:46.896927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:46.897393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:46.898084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:46.898533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:46.898982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:46.929224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-17290ac1-9269-45f9-b531-aec11acb1a5f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045360 Sep 13 16:11:46.929944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 317/626] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:47.072488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:47.074643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:47.081612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:47.082090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:47.082526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:47.083252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:47.083700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:47.084120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:47.113247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6fc00679-a289-460b-94ed-4c049f4cbc5b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Sep 13 16:11:47.113792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 310/627] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:47.941905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:47.943686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:47.950373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:47.950858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:47.951320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:47.952009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:47.952491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:47.952911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:47.982978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-42e0e6e8-ba30-4e5e-af84-d3a1fe9c93f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045902 Sep 13 16:11:47.983545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 318/628] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:48.127199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:48.129340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:48.136055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:48.136542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:48.136977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:48.137662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:48.138112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:48.138537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:48.154935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:48.170732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10eae7b1-352a-43a7-80c1-dcc01b996b59 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048231 Sep 13 16:11:48.171307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 311/629] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:48.997378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:48.999447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:49.006579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:49.007108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:49.007547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:49.008240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:49.008690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:49.009177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:49.041570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7b2d35c-fbff-48ae-be99-b9618f6411c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048240 Sep 13 16:11:49.042451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 319/630] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:49.184087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:49.186222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:49.189655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:49.195120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:49.195599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:49.196028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:49.196710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:49.197158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:49.197582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:49.228380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31a5d6d9-9775-42b2-aaf0-57fa25d80ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 Sep 13 16:11:49.228938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 312/631] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:50.054427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:50.056577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:50.063011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:50.064153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:50.064678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:50.065276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:50.065727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:50.066151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:50.095816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b2d0bf6-eb50-4594-a882-919237720919 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045249 Sep 13 16:11:50.099587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 320/632] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:50.242325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:50.245474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:50.253771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:50.254329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:50.254874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:50.255600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:50.256082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:50.256596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:50.286778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62a44ce3-fa77-448c-96b9-30de3b4144af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049423 Sep 13 16:11:50.287367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 313/633] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:51.108610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:51.111398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:51.118009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:51.118493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:51.118952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:51.119650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:51.120102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:51.120532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:51.150810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f39314f-8bd6-49c8-b7b6-f03f69dde2e4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046204 Sep 13 16:11:51.151457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 321/634] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:51.299780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:51.302221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:51.308799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:51.309270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:51.309698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:51.310375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:51.310819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:51.311263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:51.342326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b01e1b63-640c-46f8-8d9b-b7fd11318755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047053 Sep 13 16:11:51.342862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 314/635] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:52.164703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:52.166842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:52.174124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:52.174602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:52.175072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:52.175756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:52.176209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:52.176629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:52.207147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4f5c9b8-ae66-4a17-9b4b-1331c71ea66b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046341 Sep 13 16:11:52.207718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 322/636] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:52.355222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:52.357366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:52.363853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:52.364327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:52.364753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:52.365440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:52.366155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:52.366574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:52.395890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8d2e7bc-5c76-4af2-a0ac-aa617d3477fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Sep 13 16:11:52.396432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 315/637] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:53.220273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:53.222567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:53.228872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:53.229345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:53.229775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:53.230449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:53.230916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:53.231335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:53.260159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-60c5d8f8-122e-4506-8e81-9f3555003b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044590 Sep 13 16:11:53.260791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 323/638] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:53.408530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:53.410677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:53.417048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:53.417529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:53.417963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:53.418651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:53.419137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:53.419564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:53.448628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2fc7a82b-f856-4eac-a24a-e819c461adcb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Sep 13 16:11:53.449180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 316/639] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:54.273015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:54.275142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:54.281433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:54.282504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:54.283025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:54.283711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:54.284162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:54.284583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:54.313994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93ca3571-f1e7-48f1-ba97-df34b314fff9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044936 Sep 13 16:11:54.314791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 324/640] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:54.461315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:54.463500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:54.470718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:54.471224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:54.471663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:54.472349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:54.472800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:54.473228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:54.501908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-410cbc4a-5187-4f34-b80f-197a089f9476 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Sep 13 16:11:54.502446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 317/641] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:11:55.325709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:55.327848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:55.334234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:55.334723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:55.335192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:55.335875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:55.336322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:55.336771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:55.366781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87f986dc-6a2f-47ed-9a34-b2cd9ebe51ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Sep 13 16:11:55.367376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 325/642] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:11:55.514462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:55.516833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:55.523178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:55.523657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:55.524093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:55.524776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:55.525224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:55.525669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:55.554675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99a41484-a7d0-4130-99fb-86f2a68bbe23 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Sep 13 16:11:55.555240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 318/643] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:56.379968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:56.382074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:56.388603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:56.389109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:56.389538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:56.390217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:56.390661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:56.391793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:56.394303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:11:56.421457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-835c4554-968e-4488-9638-d3504d4f59cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046083 Sep 13 16:11:56.421997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 326/644] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:56.567606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:56.569744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:56.576253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:56.576722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:56.577151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:56.577823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:56.578265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:56.579465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:56.607502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f871666a-3c34-4a72-ae82-c6ca9883810a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Sep 13 16:11:56.608037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 319/645] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:57.433881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:57.436007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:57.442721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:57.443233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:57.443662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:57.444332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:57.444775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:57.445192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:57.475110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-394b1968-5517-46e3-a31b-67df92f10638 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045264 Sep 13 16:11:57.475650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 327/646] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:57.620370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:57.622509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:57.628954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:57.629439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:57.629877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:57.630559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:57.631041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:57.631470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:57.661559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa949297-08cd-45bb-97ff-f7e2e14a2053 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Sep 13 16:11:57.662115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 320/647] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:58.488408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:58.491081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:58.497445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:58.497926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:58.498389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:58.499112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:58.499562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:58.500128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:58.529225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b11f105f-dd3a-4b16-99a5-8ddfc767fb5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045404 Sep 13 16:11:58.529767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 328/648] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:58.674649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:58.676812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:58.683279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:58.683756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:58.684190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:58.684949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:58.685401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:58.685826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:58.714054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-053725fd-07e1-4e3c-831d-c3bbbc8fe29f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Sep 13 16:11:58.714590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 321/649] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:11:59.542221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:59.544374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:59.551507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:59.551986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:59.552418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:59.553099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:59.553549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:59.553975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:59.581964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0c4406e-ac8d-4802-9182-2b5ae3b18614 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043807 Sep 13 16:11:59.582505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 329/650] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:11:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:11:59.726201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:11:59.728495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:11:59.734762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:59.735283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:59.735744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:59.736416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:11:59.736871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:11:59.737298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:11:59.766531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ef21699-043e-413f-9ea6-67fe257ded64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Sep 13 16:11:59.767093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 322/651] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:11:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:00.594958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:00.597080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:00.603560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:00.604040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:00.604488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:00.605154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:00.605603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:00.606027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:00.635575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-97b2655a-5685-478f-8a53-3b5757e074af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044729 Sep 13 16:12:00.636120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 330/652] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:00.778794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:00.780989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:00.787305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:00.787786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:00.788221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:00.788906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:00.789359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:00.789785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:00.819836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4841ccec-6fa3-40dc-9e91-d128cdb730c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Sep 13 16:12:00.820387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 323/653] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:01.648399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:01.650463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:01.656854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:01.657331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:01.657768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:01.658450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:01.658921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:01.659346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:01.688361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-06e8c903-863d-42c8-80d6-3dbf8b691ed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044010 Sep 13 16:12:01.688916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 331/654] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:01.832735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:01.834853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:01.841151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:01.841625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:01.842059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:01.842740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:01.843219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:01.843649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:01.872427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8de7b746-012a-41a0-be71-156cc80e6538 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Sep 13 16:12:01.872978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 324/655] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:02.701196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:02.703601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:02.709884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:02.710355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:02.710781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:02.711482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:02.711925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:02.712341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:02.742031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e178e25-acee-45aa-8531-5876e9a5a130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044811 Sep 13 16:12:02.742566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 332/656] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:02.885390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:02.887559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:02.893872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:02.894355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:02.894799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:02.895634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:02.896098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:02.896527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:02.925712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-302c05c0-fa5f-4ea7-bd95-41a311e3bd40 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Sep 13 16:12:02.926252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 325/657] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:03.753853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:03.755998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:03.762231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:03.762705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:03.763171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:03.763851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:03.764298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:03.764719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:03.795000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54000fc1-94e5-458f-aa34-8c4b4bc0318c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Sep 13 16:12:03.795558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 333/658] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:03.938676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:03.940919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:03.947250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:03.947735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:03.948173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:03.948899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:03.949379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:03.949805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:03.980322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1b417b5-4d68-4e40-b1ba-36720019ed91 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Sep 13 16:12:03.980889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 326/659] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:04.808350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:04.810490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:04.812834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:12:04.812975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:12:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:12:04.815173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=72 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:04.826282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:04.826764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:04.827238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:04.828006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:04.828454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:04.828876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:04.857395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c8fdf5ce-9d3a-4fc6-b420-d0204baba9f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053405 Sep 13 16:12:04.857954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 334/660] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:04.993024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:04.995208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:05.001842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:05.002320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:05.002757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:05.003490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:05.003947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:05.004367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:05.034201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55bdf82d-4d65-4844-91cc-6f3ec36de7c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Sep 13 16:12:05.034672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 327/661] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:05.870890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:05.873017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:05.880407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:05.880894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:05.881334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:05.882027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:05.882482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:05.882922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:05.911546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4696e8fa-8121-4873-8caf-847b12ff4e35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044691 Sep 13 16:12:05.912093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 335/662] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:06.047091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:06.049321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:06.055746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:06.056232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:06.056675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:06.057364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:06.057828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:06.058282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:06.062787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:06.087926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee64cad1-ad58-4fd1-86d8-5e13fee706cd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045314 Sep 13 16:12:06.088478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 328/663] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:06.924352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:06.926511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:06.932828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:06.933300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:06.933727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:06.934401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:06.934842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:06.935285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:06.965676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00399188-a601-4c27-b4ae-32ff7997d822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Sep 13 16:12:06.966223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 336/664] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:07.100441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:07.102868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:07.109251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:07.109729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:07.110172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:07.110868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:07.111350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:07.111780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:07.143295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6d84271-5091-44f8-80fa-34d8e5c5a6a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Sep 13 16:12:07.143843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 329/665] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:08.138406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:08.140832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:08.146600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:08.147124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:08.147560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:08.148234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:08.148683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:08.149097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:08.156140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:08.158324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:08.164577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:08.165053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:08.165487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:08.166204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:08.166658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:08.167169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:08.180426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d6ab0363-0aaf-4e11-addd-48494ae37bf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207023 Sep 13 16:12:08.181199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 337/666] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:08.199304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe58efd4-6df9-4560-aa22-0190f627a588 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Sep 13 16:12:08.199855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 330/667] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:09.193199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:09.195417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:09.202822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:09.203337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:09.203778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:09.204468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:09.204924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:09.205353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:09.212922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:09.215178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:09.222418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:09.222938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:09.223372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:09.224061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:09.224510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:09.224935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:09.235882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9c67ff1-c8c0-4bd6-ad20-89e131af831f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046650 Sep 13 16:12:09.236452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 338/668] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:09.256447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c68b1fcd-9721-4700-8fac-d33b6f0ee096 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Sep 13 16:12:09.256996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 331/669] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:10.249835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:10.252782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:10.258796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:10.259304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:10.259741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:10.260447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:10.260894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:10.261314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:10.269038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:10.271298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:10.277673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:10.278155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:10.279133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:10.279311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:10.279762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:10.280189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:10.292012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd9cb727-3fc6-4aeb-8b5d-8feb62f7d4cb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Sep 13 16:12:10.292569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 339/670] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:10.310329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26409e6d-aba0-430d-a1c0-310ce7ebdac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Sep 13 16:12:10.310881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 332/671] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:11.305267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:11.307440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:11.314749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:11.315199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:11.315632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:11.316313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:11.316759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:11.317818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:11.323223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:11.325340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:11.332297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:11.332772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:11.333203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:11.333884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:11.334330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:11.334749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:11.348099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d635a80b-ec12-4f8e-b5c1-c34838fdd2ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046764 Sep 13 16:12:11.348658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 340/672] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:11.363417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5ada2b0-f2af-4d64-8179-bdb7b66379ac tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Sep 13 16:12:11.363959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 333/673] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:12.361272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:12.363421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:12.369961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.370436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.370877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.371572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.372017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.372435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.376670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:12.378968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:12.385018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.385506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.385946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.386839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.387327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.387760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.403270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-11662edc-ef3e-422c-be28-461a9e605644 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046556 Sep 13 16:12:12.403827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 341/674] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:12.417578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7e6b3d7-9611-4e0c-81f7-fa07c8e97856 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Sep 13 16:12:12.418131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 334/675] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:12.637560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:12.638050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:12.643979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.644452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.644884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.645562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.646012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.646431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.768415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:12.774395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lazy-loading 'services' on Instance uuid 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:12:12.844648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a9eb943-64c8-4373-bace-8d90edc370f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments/f285f277-588c-47f2-a0c3-7c605acf3904" status: 202 len: 0 microversion: 2.1 time: 0.210765 Sep 13 16:12:12.845352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 342/676] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:12:12 2022] DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments/f285f277-588c-47f2-a0c3-7c605acf3904 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:12:12.854459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:12.856732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:12.863671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.864223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.864940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.865812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:12.866266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:12.867233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:12.899516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51992b54-6b55-42a7-b642-b67d3e968855 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049242 Sep 13 16:12:12.900203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 335/677] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:13.417108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:13.419440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:13.426216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:13.426710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:13.427178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:13.427880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:13.428337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:13.428768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:13.429604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:13.431816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:13.438785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:13.439303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:13.439741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:13.440431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:13.440885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:13.441309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:13.459076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-42a7539a-da62-4af1-b409-88eb45aab3fa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046766 Sep 13 16:12:13.459642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 343/678] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:13.470475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-233672a3-8592-47a4-a41d-45202ae9a7a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Sep 13 16:12:13.471045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 336/679] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:13.912204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:13.914330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:13.920215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:13.921448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:13.921877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:13.922552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:13.923030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:13.923453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:13.953488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-761da702-41bf-4a5b-afde-f0157c5ae396 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Sep 13 16:12:13.954036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 344/680] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:14.470975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:14.473137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:14.479598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:14.480079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:14.480512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:14.481200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:14.481655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:14.482075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:14.482917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:14.485226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:14.491847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:14.492335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:14.492772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:14.493463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:14.493918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:14.494346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:14.512963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e017a3f-a1ee-4d06-b116-f11f54b06c11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046088 Sep 13 16:12:14.513527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 337/681] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:14.524614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ee377b9-778b-419c-91d4-c3b9e3940fe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045712 Sep 13 16:12:14.525166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 345/682] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:14.966031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:14.968299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:14.974102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:14.974574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:14.975039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:14.975715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:14.976161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:14.976583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:15.006163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-311d3020-0421-47e7-b464-dc8baf2eabf1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Sep 13 16:12:15.006697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 338/683] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:15.526332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:15.528493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:15.535798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:15.536275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:15.536703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:15.537114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:15.537587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:15.537821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:15.538234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:15.539261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:15.545521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:15.546094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:15.546561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:15.547280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:15.547738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:15.548166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:15.567659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e847d2dc-c557-4564-8f96-b923d75bfa2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045266 Sep 13 16:12:15.568212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 346/684] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:15.578042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-216e177c-2af3-4134-9e32-3c2904385342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Sep 13 16:12:15.578602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 339/685] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:16.019180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:16.021289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:16.027170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:16.027653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:16.028089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:16.028773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:16.029226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:16.029726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:16.058275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4502a795-4dea-4f61-9b7f-706beea1b5f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Sep 13 16:12:16.058834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 347/686] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:16.580309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:16.582424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:16.588988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:16.589444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:16.589870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:16.589870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:16.590556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:16.591026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:16.591449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:16.591637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:16.598584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:16.599093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:16.599522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:16.600201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:16.600646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:16.601063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:16.622203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86174ecd-0838-495f-827e-1118b6a4afde tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046028 Sep 13 16:12:16.623007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 340/687] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:16.631379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db6848fc-b1dc-4c12-98cc-e51605e661b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045741 Sep 13 16:12:16.631929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 348/688] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:17.071294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:17.073490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:17.080484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:17.080968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:17.081408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:17.082098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:17.082555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:17.083015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:17.112168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61e98492-9b84-44af-8411-7b92d10f39b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 13 16:12:17.112719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 341/689] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:17.635314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:17.637500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:17.644855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:17.645095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:17.645572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:17.645859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:17.646456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:17.646917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:17.647220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:17.647395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:17.653994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:17.655355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:17.656008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:17.656731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:17.657187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:17.657615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:17.680509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d15ebb62-cfb3-4a98-97e1-58eb71851d61 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049184 Sep 13 16:12:17.681312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 349/690] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:17.691556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a3bf941-5154-4a3d-9856-cae0c6aed0ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050615 Sep 13 16:12:17.692142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 342/691] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:18.125526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:18.128292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:18.134885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:18.135582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:18.136638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:18.137363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:18.138050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:18.139376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:18.168074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b4577f8-71b7-4ee0-83e0-651e225c573e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047219 Sep 13 16:12:18.168671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 350/692] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:18.693148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:18.695292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:18.702033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:18.702516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:18.702968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:18.703661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:18.704123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:18.704330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:18.704767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:18.706478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:18.712831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:18.713317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:18.713751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:18.714441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:18.714889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:18.715337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:18.735811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ec13eab-5d95-48cd-b8be-17abf9d8bf30 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046610 Sep 13 16:12:18.736367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 343/693] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:18.745789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87f52f77-638c-4cfb-8256-3c201c45a5b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Sep 13 16:12:18.746335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 351/694] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:19.181337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:19.183442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:19.190239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:19.190712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:19.191184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:19.191862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:19.192310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:19.192729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:19.216893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:19.222405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6fad3911-eafd-4266-8d19-daf81d1653c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Sep 13 16:12:19.222962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 344/695] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:19.747942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:19.750083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:19.756947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:19.757438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:19.757873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:19.758596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:19.758710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:19.759167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:19.759485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:19.760777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:19.763242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=66 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:19.768845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:19.769338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:19.769778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:19.770486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:19.770964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:19.771451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:19.790138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3fcd2e3e-6ae6-4986-81ab-b52fe5de5345 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046261 Sep 13 16:12:19.790808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 352/696] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:19.802707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb3b6405-c3ec-40ec-9089-4b2cbbbc870b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047884 Sep 13 16:12:19.803319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 345/697] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:20.234736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:20.236952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:20.243190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:20.243681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:20.244116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:20.244806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:20.245253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:20.245678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:20.275710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c33d5d9-5517-4751-8b35-bed584ae156a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044901 Sep 13 16:12:20.276331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 353/698] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:20.803800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:20.805978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:20.813486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:20.813963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:20.814394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:20.815116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:20.815569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:20.815995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:20.816272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:20.818502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:20.824303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:20.824783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:20.825217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:20.825903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:20.826352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:20.827347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:20.847671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-574722ab-8254-4964-ae2a-d2f6aa0393fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047842 Sep 13 16:12:20.848280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 346/699] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:20.858107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-217b5596-a7ac-455a-81d7-5af383d9c885 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Sep 13 16:12:20.858663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 354/700] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:21.289076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:21.291277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:21.297625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:21.298102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:21.298535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:21.299257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:21.299704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:21.300124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:21.336977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-456749b7-f9f3-41c1-a848-67021e2ad766 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051891 Sep 13 16:12:21.337562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 347/701] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:21.861051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:21.863704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:21.869745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:21.870308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:21.870792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:21.871259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:21.871898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:21.872004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:21.872390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:21.872890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:21.878463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:21.879642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:21.880092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:21.880793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:21.881249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:21.881679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:21.902695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6de27050-e179-420b-855e-3082c761a52f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Sep 13 16:12:21.903292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 355/702] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:21.911638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b2caf73e-8a8c-473f-a1ab-b20363fc1114 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Sep 13 16:12:21.912197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 348/703] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:22.349588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:22.351714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:22.357520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:22.358642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:22.359119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:22.359783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:22.360232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:22.360652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:22.389852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d42fd05-709c-47e5-b3b7-c985f33f1dc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Sep 13 16:12:22.390386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 356/704] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:22.915940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:22.918098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:22.924336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:22.924948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:22.925420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:22.925849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:22.926479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:22.926598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:22.926991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:22.927411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:22.932861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:22.933338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:22.933776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:22.934462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:22.934925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:22.935370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:22.956851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b69b54ff-88ee-4f50-981f-896ca33248c6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044815 Sep 13 16:12:22.957420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 349/705] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:22.965072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-055f1ae9-cc9e-47b6-8e47-96dc0327e7dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Sep 13 16:12:22.965671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 357/706] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:23.401778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:23.403976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:23.410457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:23.410944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:23.411384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:23.412069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:23.412529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:23.412949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:23.442196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95da40f9-8597-4cc6-a360-d3a342eedec9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 13 16:12:23.442749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 350/707] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:23.969542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:23.972574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:23.976976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:23.979032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:23.979301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:23.979511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:23.979941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:23.980628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:23.981079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:23.981497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:23.985376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:23.985886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:23.986327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:23.987048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:23.987504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:23.987934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:24.007216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:24.012919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-255d56ca-e5dc-4bea-a985-60229eb688e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047384 Sep 13 16:12:24.013487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 358/708] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:24.018258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-186461bd-ede3-48af-bb1f-89e29aa86a62 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Sep 13 16:12:24.018810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 351/709] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:24.454334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:24.456548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:24.463785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:24.464264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:24.464702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:24.465392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:24.465842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:24.466270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:24.496346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a4de736-cbdf-43bf-87ff-fdf57ef63cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Sep 13 16:12:24.496901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 359/710] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:25.026191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:25.028268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:25.031257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:25.033428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:25.035334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:25.035817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:25.036253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:25.036944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:25.037397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:25.037822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:25.039736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:25.040217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:25.040651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:25.042533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:25.042533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:25.042533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:25.068822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2fc3c162-8af7-4f2d-8855-913a3dbb20f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046678 Sep 13 16:12:25.069425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 352/711] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:25.072999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87c813c8-f816-425d-906d-930814dc24f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Sep 13 16:12:25.073551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 360/712] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:25.509774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:25.511943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:25.517893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:25.518378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:25.518845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:25.519559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:25.520014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:25.520444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:25.550168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72c17785-6d15-46d9-875b-a9ed2a258814 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Sep 13 16:12:25.550730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 353/713] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:26.081495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:26.083647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:26.085278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:26.087196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:26.090275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:26.090757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:26.091288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:26.092027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:26.092481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:26.092905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:26.093517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:26.093992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:26.094422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:26.095135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:26.095585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:26.096005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:26.122515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2708bbd-7594-426f-9a5d-769704f6fe7d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045060 Sep 13 16:12:26.123701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 361/714] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:26.127408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0708f23b-f7f9-4936-9452-11d77615e5c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Sep 13 16:12:26.127956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 354/715] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:26.562523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:26.564668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:26.570490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:26.570992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:26.571423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:26.572094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:26.572539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:26.572956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:26.601460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a22f167-b550-4f16-9cc2-77ef073d5afc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Sep 13 16:12:26.601997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 362/716] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:27.135534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:27.137693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:27.140235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:27.142372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:27.145175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:27.145653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:27.146080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:27.146770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:27.147242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:27.147665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:27.148560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:27.149041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:27.149470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:27.150150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:27.150593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:27.151046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:27.178353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5810f444-8374-43cd-8a22-870c4a286f9d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046768 Sep 13 16:12:27.178998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 355/717] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:27.179629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3cf60346-4924-48c6-9caf-97138082155a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Sep 13 16:12:27.180179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 363/718] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:27.614203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:27.616359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:27.622193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:27.622687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:27.624349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:27.625036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:27.625489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:27.625923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:27.654771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf669a54-4f20-475b-9540-252c7e3cf537 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Sep 13 16:12:27.655334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 356/719] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:28.191527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:28.192063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:28.193568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:28.194107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:28.200024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:28.200506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:28.200636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:28.201595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:28.201708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:28.202032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:28.202400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:28.202752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:28.202848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:28.203233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:28.203332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:28.203660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:28.233329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9312b02e-72bd-4ac7-ae40-ddd3cc051374 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045803 Sep 13 16:12:28.233578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6daf9478-783d-4eb7-aca1-32271cef8651 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045525 Sep 13 16:12:28.234016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 357/720] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:28.234203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 364/721] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:28.666864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:28.669070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:28.675770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:28.676248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:28.676681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:28.677363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:28.677812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:28.678229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:28.708437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-077e7042-d61f-44cb-ae7c-277c0ccaba47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Sep 13 16:12:28.708977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 358/722] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:29.246752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:29.247333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:29.249484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:29.249603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:29.255696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:29.255855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:29.256170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:29.256280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:29.256598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:29.256783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:29.257283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:29.257382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:29.257728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:29.257825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:29.258147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:29.258245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:29.287834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2684769c-c4bb-4bb6-b4c9-d3b74724dff5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045075 Sep 13 16:12:29.288096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aef1e243-08bc-4e39-9440-5c1f07a895c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 Sep 13 16:12:29.288386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 365/723] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:29.288654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 359/724] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:29.722002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:29.724122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:29.730027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:29.730507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:29.730965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:29.731652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:29.732103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:29.732721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:29.761372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f36ebd0b-cb40-4320-8c93-8ddc465e6f33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 Sep 13 16:12:29.761943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 366/725] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:30.300497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:30.301154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:30.302718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:30.303935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:30.309378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:30.310389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:30.310829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:30.311458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:30.311761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:30.311964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:30.312214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:30.312392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:30.312640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:30.313082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:30.313530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:30.313950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:30.343277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a437a5ec-503b-4f0b-8bff-9467e595e3cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Sep 13 16:12:30.343521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65ef5955-e9c3-43f4-a4f5-63e0ebed2eff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046711 Sep 13 16:12:30.343846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 360/726] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:30.348108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 367/727] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:30.774066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:30.776272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:30.783038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:30.783517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:30.783948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:30.784628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:30.785075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:30.785493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:30.802750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:30.817500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ff27084-dc8f-488f-967b-ee58efefeb0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047565 Sep 13 16:12:30.818060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 361/728] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:31.355703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:31.356303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:31.358386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:31.358588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:31.365275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:31.365422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:31.366266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:31.366365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:31.366469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:31.366911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:31.367160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:31.367752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:31.367883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:31.368196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:31.368457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:31.369107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:31.400558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a039c52b-d0ac-431d-9074-cb60f58e4c25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048722 Sep 13 16:12:31.400937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2bf8e4b-b8db-40af-9e2d-a01c67db1aa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Sep 13 16:12:31.401644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 368/729] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:31.401906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 362/730] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:31.829907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:31.832100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:31.838122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:31.838599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:31.839079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:31.839762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:31.840212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:31.840633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:31.870359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f3f471c-c6ee-4fc7-84b9-fad62e67c158 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Sep 13 16:12:31.870914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 369/731] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:32.412860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:32.413396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:32.415090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:32.415257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:32.421879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:32.422046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:32.422362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:32.422480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:32.422801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:32.422916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:32.423524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:32.423624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:32.423980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:32.424079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:32.424401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:32.424496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:32.454662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4b80026-1606-4c96-9303-87b1cab1ac07 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 Sep 13 16:12:32.455066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de8fa3d3-dad5-41a3-b4c0-5a01d80597a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046198 Sep 13 16:12:32.458959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 370/732] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:32.459130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 363/733] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:32.882981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:32.885062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:32.891005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:32.891489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:32.891928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:32.892609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:32.893058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:32.893481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:32.922219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0b90c46-b0c9-4ea7-8487-e00df2987212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Sep 13 16:12:32.922759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 371/734] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:33.467445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:33.468100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:33.469559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:33.469702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:33.475758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:33.475911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:33.476263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:33.476475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:33.476695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:33.476803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:33.477470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:33.477588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:33.477920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:33.478018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:33.478340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:33.478433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:33.508694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d08afd64-8e99-4b75-bd3a-27af6ec6157d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Sep 13 16:12:33.509163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a1c66f62-c9ed-4830-be2c-b878dccc3d17 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045596 Sep 13 16:12:33.509278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 364/735] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:33.509734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 372/736] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:33.933707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:33.936070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:33.941930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:33.942415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:33.942855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:33.943573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:33.944030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:33.944456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:33.973843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d522931c-0166-40a9-997f-f7ebfcff578e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Sep 13 16:12:33.974391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 365/737] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:34.521591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:34.522253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:34.523756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:34.524414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:34.531041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:34.531547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:34.531721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:34.531967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:34.532173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:34.532611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:34.532766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:34.533102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:34.533305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:34.533525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:34.533922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:34.534180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:34.563801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e030af4-4013-411e-8e61-dd035319c1ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046214 Sep 13 16:12:34.564371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 373/738] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:34.566161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88899875-72e1-49a6-8435-302ddbdb36e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048524 Sep 13 16:12:34.566718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 366/739] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:34.987020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:34.989309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:34.991165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=80 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:34.996333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:34.996813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:34.998096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:34.998771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:34.999252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:34.999681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:35.028124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07755756-2f0d-4cc9-a8b8-4418e8a479f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Sep 13 16:12:35.028788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 374/740] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:35.577612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:35.578304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:35.579769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:35.579936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:35.586185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:35.586318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:35.586663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:35.586768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:35.587128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:35.587240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:35.587812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:35.587909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:35.588260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:35.588368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:35.588687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:35.588781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:35.603027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:35.619999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8976af00-2ed9-4a61-a90a-91c3c81a5dcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Sep 13 16:12:35.620418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62921df8-b0c3-49ba-8cb4-0c2c2c67da07 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046951 Sep 13 16:12:35.620846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 375/741] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:35.620970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 367/742] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:36.040835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:36.043125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:36.049369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:36.049855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:36.050297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:36.051022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:36.051482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:36.051910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:36.082682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-143e7c29-0803-4dc7-a5de-03f17f4a8554 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Sep 13 16:12:36.083216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 376/743] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:36.632113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:36.632695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:36.634289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:36.634792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:36.640792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:36.641267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:36.641379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:36.641695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:36.641808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:36.642170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:36.642383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:36.642832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:36.642951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:36.643284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:36.643397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:36.643722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:36.672952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b183f019-dffd-4fb1-b237-708f38bd780b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044179 Sep 13 16:12:36.673191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7345019-6b7b-46e0-af7f-6bf8908da971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Sep 13 16:12:36.673511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 368/745] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:36.673636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 377/745] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:37.095960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:37.098088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:37.104542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:37.105014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:37.105445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:37.106785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:37.107283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:37.107786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:37.139937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa9c9ce3-dbd1-46ae-ac79-c0caad4725fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047884 Sep 13 16:12:37.140389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 369/746] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:37.686278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:37.686940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:37.688622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:37.688761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:37.695109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:37.695586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:37.696011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:37.696697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:37.697142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:37.697597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:37.697737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:37.698515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:37.698976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:37.699665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:37.700851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:37.701402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:37.727324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8bf36a2-4d73-4fbe-afe7-2c81a8f2edaa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045525 Sep 13 16:12:37.727882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 370/747] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:37.730574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b957ce0-aee6-4382-8d05-54c0ab735a54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048953 Sep 13 16:12:37.731188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 378/748] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:38.152213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:38.155057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:38.160890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:38.161379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:38.161931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:38.162626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:38.163205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:38.163722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:38.192680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d8aa3d8-94e7-45ba-8823-f27b3ab16d3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Sep 13 16:12:38.193164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 371/749] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:38.740164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:38.742335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:38.743333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:38.745452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:38.749519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:38.750003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:38.750438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:38.751159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:38.751630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:38.752043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:38.752364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:38.752837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:38.753266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:38.753942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:38.754386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:38.754813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:38.781865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86e42de4-f28c-4920-91dd-f17f4273d194 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Sep 13 16:12:38.782569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 379/750] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:38.783915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c70982c-7563-4afb-bed0-802cc8af48d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044426 Sep 13 16:12:38.784476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 372/751] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:39.204938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:39.207125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:39.212976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:39.213453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:39.213884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:39.214555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:39.215039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:39.215973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:39.245103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa0cd825-833f-420a-be1f-4fae49683220 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Sep 13 16:12:39.245581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 380/752] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:39.794640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:39.796473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:39.796860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:39.798603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:39.803348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:39.803822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:39.804253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:39.804411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:39.804951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:39.805100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:39.805454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:39.805633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:39.806217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:39.806326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:39.806790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:39.807308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:39.836980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c01f8763-aee1-465a-883b-5741d64a0265 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Sep 13 16:12:39.837537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 373/753] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:39.837684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7b203b4-92f6-424c-8160-ba745a55f6b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045125 Sep 13 16:12:39.838228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 381/754] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:40.257638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:40.259854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:40.265867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:40.266348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:40.266785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:40.267570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:40.268020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:40.268446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:40.297941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c23a1ce-1622-417f-9234-9f3692b107cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Sep 13 16:12:40.298415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 374/755] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:40.849703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:40.850308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:40.851866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:40.851983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:40.859023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:40.859504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:40.859611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:40.859962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:40.860145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:40.860587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:40.860685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:40.861086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:40.861338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:40.861505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:40.861791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:40.862234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:40.892172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bad3627-d77c-4e8e-8752-24030c9470bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Sep 13 16:12:40.892736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 382/756] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:40.893105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1506fe9a-70ee-432b-bbe0-a53fb9bcd707 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047335 Sep 13 16:12:40.893661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 375/757] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:41.310352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:41.312586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:41.318321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:41.318805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:41.319275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:41.319955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:41.320406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:41.320829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:41.349547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92cf9b3a-23e8-4ff2-ae2e-8549304b5487 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Sep 13 16:12:41.350088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 383/758] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:41.905105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:41.905861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:41.907232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:41.907353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:41.913607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:41.913761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:41.914091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:41.914216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:41.914536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:41.914661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:41.915254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:41.915363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:41.915703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:41.915808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:41.916118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:41.916214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:41.945996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d7ec7240-0e1f-4a54-a1aa-0c978f1f20a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044881 Sep 13 16:12:41.946543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 376/759] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:41.946686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86bef441-c8a0-41d4-9169-81e30ead6767 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Sep 13 16:12:41.947138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 384/760] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:42.361735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:42.364151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:42.369982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:42.370461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:42.370915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:42.371790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:42.372240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:42.372663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:42.401407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c1a430c-69e7-41cb-abc0-719b97e3a110 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 Sep 13 16:12:42.401948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 377/761] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:42.958634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:42.959228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:42.960867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:42.961013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:42.967610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:42.967821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:42.968094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:42.968297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:42.968532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:42.968731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:42.969223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:42.969412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:42.969677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:42.969857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:42.970104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:42.970273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:42.973822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:43.000771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77786310-9273-490b-b55f-2046b2755f27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Sep 13 16:12:43.001347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 378/762] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:43.001495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f45d8495-66f1-44f5-9e6a-5a4f5ece8d02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046778 Sep 13 16:12:43.001956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 385/763] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:43.413871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:43.416066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:43.422565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:43.423079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:43.423509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:43.424188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:43.424633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:43.425050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:43.454712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb2cdbee-9153-46ca-b275-4c6b50f295e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Sep 13 16:12:43.455278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 379/764] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:44.013863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:44.014434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:44.016062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:44.016492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:44.022416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:44.022693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:44.022913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:44.023204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:44.023359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:44.023641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:44.024045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:44.024331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:44.024496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:44.024787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:44.024927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:44.025213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:44.054874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34b1a169-9d9a-4a82-846f-19b80a92c5a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045582 Sep 13 16:12:44.055715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 386/765] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:44.056683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47804024-12e3-468d-8ae1-4e2082e130ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046752 Sep 13 16:12:44.057243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 380/766] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:44.466527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:44.468686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:44.474547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:44.475048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:44.475478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:44.476152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:44.476596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:44.477013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:44.506840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65b63142-7ec3-460f-86b6-c1d1f0719b69 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Sep 13 16:12:44.507414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 387/767] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:45.067380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:45.068833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:45.069502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:45.070923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:45.076315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:45.076791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:45.077221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:45.077903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:45.078333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:45.078450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:45.078752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:45.078850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:45.079262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:45.079948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:45.080390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:45.080814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:45.107478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02a66ce7-2e1b-45f6-95f7-b486727feee1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Sep 13 16:12:45.108047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 381/768] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:45.110918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-824192a7-7dd0-4762-99d9-3d2882dc26ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045765 Sep 13 16:12:45.111468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 388/769] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:45.519174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:45.521326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:45.527231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:45.527702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:45.528135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:45.528812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:45.529259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:45.529679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:45.558952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41b24b28-da8c-403e-99ab-782af5d8867b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Sep 13 16:12:45.559598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 382/770] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:46.119441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:46.121639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:46.123373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:46.125468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:46.128214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:46.128698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:46.129138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:46.129949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:46.130417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:46.130844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:46.131631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:46.132107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:46.132544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:46.133224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:46.133668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:46.135367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:46.160921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d519d16-4729-4e68-ab0d-b3b7eea13bad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Sep 13 16:12:46.161483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 389/771] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:46.164142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d655481a-42ab-40ce-9e2f-d87067e90420 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044915 Sep 13 16:12:46.164700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 383/772] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:46.571987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:46.574813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:46.580717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:46.581190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:46.581626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:46.582299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:46.582762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:46.583211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:46.611535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-072067d5-01fd-47a8-907c-ef0fb0441bee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Sep 13 16:12:46.612272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 390/773] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:47.174364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:47.176338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:47.176749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:47.178590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:47.182922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:47.184702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:47.185144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:47.185413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:47.185841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:47.185943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:47.186290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:47.186389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:47.186710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:47.187011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:47.187462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:47.187887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:47.216783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a0ae176-07a8-4e6a-a091-8161cc80b5af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Sep 13 16:12:47.217288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b45ba717-dcd9-41fe-9c5c-746651e157a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044832 Sep 13 16:12:47.217413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 384/774] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:47.217841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 391/775] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:47.624008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:47.626129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:47.632042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:47.632518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:47.632949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:47.633627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:47.634075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:47.634496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:47.663683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93bcff46-4a9f-4a21-afe1-8b61247acf26 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Sep 13 16:12:47.664163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 385/776] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:48.229288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:48.229839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:48.231546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:48.232052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:48.238315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:48.238704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:48.238832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:48.239218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:48.239350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:48.239645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:48.239965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:48.240358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:48.240465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:48.240803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:48.240925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:48.241217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:48.246357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:48.272340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-052b215b-44b7-4f9b-948e-d09bcdc0fc3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047328 Sep 13 16:12:48.272583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f288cac1-0548-415c-a56e-16f515ef7024 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047084 Sep 13 16:12:48.272905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 392/777] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:48.273094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 386/778] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:48.675990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:48.678136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:48.684927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:48.685419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:48.685855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:48.686539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:48.687015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:48.687441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:48.716147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffec493a-886a-4a7d-9124-b344f2e4bfc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Sep 13 16:12:48.716705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 393/779] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:49.284975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:49.285529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:49.287127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:49.287251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:49.294071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:49.294249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:49.294554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:49.294708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:49.295028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:49.295158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:49.295717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:49.295827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:49.296165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:49.296270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:49.296588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:49.296687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:49.326713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb31ca16-b087-4cb8-9594-306d9d1d974f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Sep 13 16:12:49.327193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-299b7d8c-0808-4e58-bb4f-6758ccf3511c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046030 Sep 13 16:12:49.327327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 394/780] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:49.327752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 387/781] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:49.728561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:49.730722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:49.736587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:49.737330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:49.737772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:49.738462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:49.738934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:49.739362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:49.768868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8844ba3f-2ad3-476d-abf2-9fbfa859ef36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Sep 13 16:12:49.769416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 395/782] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:50.339909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:50.340470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:50.342123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:50.342252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:50.344543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:50.348625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:50.349113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:50.349549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:50.349926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:50.350248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:50.350433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:50.350702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:50.350867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:50.351155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:50.351570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:50.352015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:50.352431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:50.381954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9799f405-6bf4-4f6f-9eb9-aa61221eda8a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046426 Sep 13 16:12:50.382715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 396/783] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:50.382920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35532e6d-df47-4801-ba0d-fae83d33f741 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047404 Sep 13 16:12:50.383508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 388/784] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:50.781435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:50.783632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:50.789576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:50.790061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:50.790501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:50.791213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:50.791668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:50.792096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:50.822374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e3b8413-f48c-46ac-92d4-33f26f7438e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Sep 13 16:12:50.822949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 397/785] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:51.394859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:51.395422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:51.397025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:51.397137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:51.403624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:51.404114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:51.404553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:51.404713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:51.405193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:51.405309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:51.405622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:51.405735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:51.406111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:51.406299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:51.407042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:51.407459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:51.436362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3aee6743-1583-4d9a-9722-3d1e9130bcfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Sep 13 16:12:51.436963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 389/786] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:51.439098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6298d379-9b8c-4db7-b7db-63837ef2787e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048121 Sep 13 16:12:51.439658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 398/787] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:51.834991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:51.837134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:51.843547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:51.844029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:51.844467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:51.845160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:51.845616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:51.846045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:51.876505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-856863a7-ad5f-4292-af3a-f57c2ca8f4c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Sep 13 16:12:51.877063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 390/788] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:52.448396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:52.450647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:52.451791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:52.453885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:52.457233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:52.457382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:52.457778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:52.458472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:52.458952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:52.459378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:52.460129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:52.460603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:52.461035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:52.461714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:52.462161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:52.462589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:52.489308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6352d12-ea45-4466-b040-a153618dcf14 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044954 Sep 13 16:12:52.489869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 399/789] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:52.493232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc76bff8-c0a6-41b9-b8d4-caab76a751f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045949 Sep 13 16:12:52.493902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 391/790] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:52.889312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:52.891460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:52.897286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:52.897763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:52.898192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:52.898868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:52.899356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:52.899764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:52.928433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2fb4612b-b4fe-41b5-a2d6-1dacadf30310 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Sep 13 16:12:52.928975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 400/791] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:53.502084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:53.504242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:53.506207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:53.508401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:53.510628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:53.511739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:53.512175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:53.512872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:53.513323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:53.514043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:53.515410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:53.515897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:53.516338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:53.517022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:53.517480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:53.517908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:53.543158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3314adf3-91c2-422f-9ebf-7a96b53cc631 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Sep 13 16:12:53.543717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 392/792] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:12:53.546780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb58ece3-82ae-49d3-8bf2-aa6afaef44ec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Sep 13 16:12:53.549200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 401/793] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:53.940705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:53.942932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:53.949368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:53.949839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:53.950268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:53.950968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:53.951418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:53.951859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:53.980671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30a81844-c7f7-4005-a9a7-dafa34bb8b00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Sep 13 16:12:53.981224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 393/794] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:54.554689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:54.556865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:54.560540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:54.562660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:54.563323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:54.563807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:54.564260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:54.564945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:54.565388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:54.565810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:54.569110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:54.569596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:54.570032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:54.570730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:54.571212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:54.571642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:54.598516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:54.598805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-40c98925-3363-4fbc-a248-0b54cbc9241c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048047 Sep 13 16:12:54.599408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 402/795] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:54.604036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2a09946-baac-4605-b49c-92c26742cd8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047617 Sep 13 16:12:54.604768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 394/796] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:54.992578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:54.994779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:55.001194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:55.001681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:55.002121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:55.002811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:55.003294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:55.003728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:55.032528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a716d7e-2f3e-48fb-8f7d-f7215cf4ae80 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Sep 13 16:12:55.033072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 403/797] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:55.612153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:55.614283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:55.616739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:55.618826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:55.620934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:55.621412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:55.621850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:55.622546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:55.623025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:55.623453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:55.625204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:55.625692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:55.626129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:55.626819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:55.627397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:55.627824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:55.652905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b6aec47f-e59c-4204-9151-0a2ef2a841d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Sep 13 16:12:55.653461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 395/798] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:55.657177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3ef47e7-cd31-4bd6-a580-75f4987b990d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044383 Sep 13 16:12:55.657895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 404/799] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:56.045414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:56.047593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:56.053498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:56.053984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:56.054430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:56.055168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:56.055624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:56.056070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:56.085467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9942f8d6-096d-4ec9-8c27-b577b0fb4bf3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Sep 13 16:12:56.086017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 396/800] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:56.665497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:56.668493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:56.669989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:56.672142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:56.674933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:56.675415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:56.675845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:56.676538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:56.676988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:56.677411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:56.678439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:56.678942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:56.679379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:56.680063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:56.680508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:56.680931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:56.707208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-928f44ee-6d13-4f61-b6b1-d0b5d9277399 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045628 Sep 13 16:12:56.707773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 405/801] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:56.710319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0554102b-4bcd-401d-87ff-a3d712e6ff45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044734 Sep 13 16:12:56.710870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 397/802] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:57.098351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:57.100567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:57.106439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:57.106940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:57.107379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:57.108066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:57.108519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:57.108941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:57.138626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a189224f-89fe-4900-b9bf-8e47ba4062ee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Sep 13 16:12:57.139197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 406/803] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:57.719925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:57.722099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:57.722252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:57.724393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:57.728522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:57.729013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:57.729680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:57.730413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:57.730629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:57.730869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:57.731145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:57.731331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:57.731582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:57.732267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:57.732716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:57.733185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:57.761401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a3f9497-9ff6-4653-aa04-5e130ae15577 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Sep 13 16:12:57.761972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 398/804] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:57.762994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cbbfd46-583e-48a8-99b3-a140982469af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044573 Sep 13 16:12:57.763553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 407/805] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:12:58.151055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:58.153659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:58.159683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:58.160192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:58.160627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:58.161320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:58.161775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:58.162201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:58.192587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b107976-9b7b-4693-8764-e8dde3f6ccde tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Sep 13 16:12:58.193143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 399/806] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:58.775158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:58.775744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:58.777985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:58.778108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:58.784349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:58.784492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:58.784822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:58.784945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:58.785255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:58.785362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:58.785939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:58.786054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:58.786384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:58.786489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:58.786806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:58.786947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:58.815035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:12:58.818058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80a1578d-a601-4959-b58b-af62d1bdb453 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046741 Sep 13 16:12:58.818604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 400/807] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:58.820321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68f653d2-e674-40ec-8703-a085d18f26be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049113 Sep 13 16:12:58.820886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 408/808] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:59.205447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:59.207678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:59.214225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:59.214707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:59.215179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:59.215870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:59.216320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:59.216743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:59.245585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d2ce2bb-3daa-459f-b33d-491f0d7be1c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Sep 13 16:12:59.246121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 401/809] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:12:59.830714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:59.832332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:12:59.832858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:59.834463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:12:59.840087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:59.840564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:59.840939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:59.841064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:59.841426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:59.841663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:59.841869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:59.842107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:59.842524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:59.842635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:12:59.843042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:12:59.843478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:12:59.872855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a2e5809-9483-4aa0-81c9-6ad2c6375c74 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046135 Sep 13 16:12:59.873201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d49ebfe3-540f-459c-ac8e-216286fe37e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Sep 13 16:12:59.873442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 409/810] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:12:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:12:59.874062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 402/811] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:12:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:00.258667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:00.261074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:00.266860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:00.267382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:00.267813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:00.268502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:00.268953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:00.269373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:00.299397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1537396-a371-4457-84e2-91803d05f501 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 13 16:13:00.299952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 410/812] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:00.885912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:00.886610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:00.888108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:00.888214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:00.894530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:00.894703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:00.895045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:00.895162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:00.895480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:00.895588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:00.896169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:00.896272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:00.896619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:00.896728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:00.897043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:00.897138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:00.926360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-858540ff-e64c-4e74-8835-b3f153599e3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045111 Sep 13 16:13:00.926936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 411/813] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:00.927066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34a2565c-308f-420f-af39-532ad3282c3e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Sep 13 16:13:00.927607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 403/814] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:01.312526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:01.315150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:01.321130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:01.321607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:01.322037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:01.323814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:01.324269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:01.324693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:01.354046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73dcc3d0-fb49-4175-ba30-713a451b6c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045531 Sep 13 16:13:01.354593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 412/815] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:01.939287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:01.939905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:01.941409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:01.941515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:01.947823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:01.948045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:01.948307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:01.948530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:01.948742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:01.948966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:01.949433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:01.949657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:01.949993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:01.950111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:01.950422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:01.950529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:01.980261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5349bd6-c743-4315-b777-cc58c538d382 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Sep 13 16:13:01.980610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-624464aa-4436-432f-92b9-5511951235e6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045293 Sep 13 16:13:01.981061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 413/816] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:01.981253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 404/817] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:02.367478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:02.369789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:02.375765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:02.376250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:02.376681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:02.377395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:02.377915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:02.378336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:02.407311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7898825a-932d-4ef1-8652-5b121aec0a52 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Sep 13 16:13:02.407862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 414/818] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:02.993066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:02.993595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:02.995335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:02.995592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:03.001800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:03.001972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:03.002282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:03.002385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:03.002719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:03.002866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:03.003454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:03.003560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:03.003906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:03.004009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:03.004335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:03.004433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:03.034712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87f91841-7350-40c4-a8b2-31594b0576ad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045397 Sep 13 16:13:03.034975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5719b2a-12f0-499f-ac8d-182d04428699 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Sep 13 16:13:03.035492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 415/819] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:03.035623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 405/820] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:03.420178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:03.422312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:03.428180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:03.428649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:03.429075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:03.429749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:03.430194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:03.430612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:03.459825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2123539f-6c58-4466-8849-51048889d8ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Sep 13 16:13:03.460382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 416/821] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:04.048021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:04.048588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:04.050148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:04.050291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:04.056868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:04.057313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:04.057424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:04.057813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:04.057922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:04.058278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:04.058523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:04.058994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:04.059116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:04.059419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:04.059523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:04.059857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:04.090395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c37ca5c-fed0-4506-a841-7b81605060b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046250 Sep 13 16:13:04.090829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69b815cc-d08b-4eff-abbd-7b234f2b54ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046683 Sep 13 16:13:04.091020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 406/822] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:04.091409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 417/823] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:04.472232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:04.474400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:04.481029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:04.481507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:04.481944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:04.482629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:04.483127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:04.483555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:04.512778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46ca2da4-c1d4-40e0-ade3-41ec24faf19a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Sep 13 16:13:04.513325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 407/824] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:05.103137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:05.103716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:05.105311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:05.105433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:05.107662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:05.112396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:05.112896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:05.113071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:05.113328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:05.113551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:05.113985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:05.114098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:05.114448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:05.114673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:05.114867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:05.115149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:05.115576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:05.144241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18dfa504-e3a8-44d7-b742-08a6d9b86b8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045042 Sep 13 16:13:05.144794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 408/825] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:05.144961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81d585dc-dbf0-4dce-81f5-e1d56d6a6985 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Sep 13 16:13:05.145511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 418/826] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:05.525213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:05.527402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:05.533424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:05.533914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:05.534355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:05.535080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:05.535540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:05.535972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:05.566875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5577b47f-b5fd-40f3-b46e-1ba121d3295e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Sep 13 16:13:05.567510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 409/827] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:06.157578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:06.158751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:06.159724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:06.160890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:06.167500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:06.167701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:06.168000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:06.168113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:06.168432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:06.168544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:06.169127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:06.169228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:06.169586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:06.169691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:06.170011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:06.170119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:06.199451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-893fc0bc-81f9-4f47-ba87-cb1a9446565b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Sep 13 16:13:06.199694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-74bd8845-9f00-4d33-a06f-a73e63cd256e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046042 Sep 13 16:13:06.200030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 410/828] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:06.203176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 419/829] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:06.579255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:06.581391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:06.587284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:06.588395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:06.588833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:06.589520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:06.590066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:06.590540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:06.606807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:06.620503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0dc96f04-c83c-407a-bc56-07c8d5885a03 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 13 16:13:06.621043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 411/830] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:07.211736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:07.212265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:07.214038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:07.214231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:07.220493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:07.220652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:07.220971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:07.221072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:07.221403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:07.221515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:07.222085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:07.222183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:07.222529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:07.222625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:07.222971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:07.223073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:07.253490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b696969-8492-4ba0-8b8b-2be70cb1d6d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Sep 13 16:13:07.254047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 412/831] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:07.254178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1af84e0-0ddb-4aab-a228-ed6412d52cad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046300 Sep 13 16:13:07.254595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 420/832] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:07.632815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:07.635887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:07.643150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:07.643639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:07.644080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:07.644771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:07.645227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:07.645658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:07.675841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b11a6c5-d9b0-4324-a8f3-c162a8acd574 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Sep 13 16:13:07.676389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 413/833] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:08.266039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:08.266585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:08.268268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:08.268439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:08.274419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:08.274607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:08.275458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:08.275673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:08.275890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:08.276053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:08.276574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:08.276933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:08.277030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:08.277387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:08.277517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:08.277805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:08.307759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92b1c5c8-16be-41ce-9e30-279c574f0133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Sep 13 16:13:08.308008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5536179c-5700-431b-a31d-7522130dad22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045611 Sep 13 16:13:08.308316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 421/834] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:08.308511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 414/835] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:08.687861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:08.690023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:08.695953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:08.696437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:08.697513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:08.698206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:08.698661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:08.699117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:08.727695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbe20cc1-12be-46b5-8f3f-90eb8104a9f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Sep 13 16:13:08.728321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 422/836] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:09.320531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:09.321132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:09.323345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:09.323633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:09.329728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:09.329863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:09.330189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:09.330311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:09.330650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:09.330772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:09.331361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:09.331486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:09.331817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:09.331915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:09.332239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:09.332335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:09.362625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2330e771-bd88-4ea6-8eba-c3aa3f4c1c05 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046116 Sep 13 16:13:09.363424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e342162d-341a-4b41-a4b5-73115db3440e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 Sep 13 16:13:09.363564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 415/837] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:09.367721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 423/838] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:09.740378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:09.742569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:09.749435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:09.749922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:09.750361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:09.751080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:09.751533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:09.751957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:09.782507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bc4d6ed-dcf5-404b-8059-06dbf6af82ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 Sep 13 16:13:09.783100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 416/839] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:10.375327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:10.375996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:10.377472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:10.377589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:10.383836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:10.384470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:10.384820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:10.385071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:10.385252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:10.385511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:10.385942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:10.386203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:10.386391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:10.386656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:10.386813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:10.387115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:10.417171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a0db89e-1af9-44b1-b212-41ab39a6a44f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045787 Sep 13 16:13:10.417402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0095d05e-6bf7-4e3e-8723-67aa47b07060 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046012 Sep 13 16:13:10.417949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 424/840] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:10.422228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 417/841] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:10.795726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:10.798013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:10.804066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:10.804549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:10.804991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:10.805677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:10.806325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:10.806749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:10.820505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:10.836409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb78b2c9-04bc-4374-92c5-f71e96b2ed32 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Sep 13 16:13:10.836955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 425/842] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:11.428880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:11.429456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:11.431657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:11.432783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:11.438328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:11.438814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:11.439008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:11.439292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:11.439484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:11.439911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:11.440103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:11.440433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:11.440600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:11.440861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:11.441032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:11.441514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:11.470961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06512d18-7125-4c88-895f-c438e0f1f26f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045974 Sep 13 16:13:11.471527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 418/843] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:11.472066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-808ca56e-016d-477f-bcae-88a1612af9e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Sep 13 16:13:11.472893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 426/844] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:11.849427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:11.851625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:11.857987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:11.858462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:11.858890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:11.859591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:11.860036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:11.860712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:11.889850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab74edf0-f0e8-4b2f-91dd-022d843790f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Sep 13 16:13:11.890400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 419/845] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:12.483621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:12.484430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:12.486010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:12.486802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:12.492465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:12.492942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:12.493070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:12.493554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:12.493742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:12.493988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:12.494657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:12.494776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:12.495132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:12.495243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:12.495553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:12.495651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:12.526238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75d5275b-a899-4128-9777-bdc439f098ff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Sep 13 16:13:12.526444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed954973-3752-4854-9cee-0b35e44fe268 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046565 Sep 13 16:13:12.526935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 427/847] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:12.527075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 420/847] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:12.901561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:12.903710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:12.909600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:12.910077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:12.910513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:12.911227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:12.911709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:12.912135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:12.941390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cada2f7-03e2-41ba-95d7-27f518482dcd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Sep 13 16:13:12.941943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 421/848] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:13.538873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:13.539487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:13.541818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:13.542300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:13.548250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:13.548555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:13.548730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:13.549033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:13.549149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:13.549465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:13.549827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:13.550147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:13.550254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:13.550592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:13.550698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:13.551045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:13.579651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c260ed3f-8904-4a17-9f2f-2e6b1b68d2f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044712 Sep 13 16:13:13.580202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 422/849] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:13.580345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d8e5c04-b22e-4ffc-a56b-f80f7dc8d42c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Sep 13 16:13:13.580792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 428/850] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:13.953543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:13.955695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:13.961521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:13.962673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:13.963148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:13.963833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:13.964284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:13.964710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:13.993185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c753fa7f-3ced-4bc2-9daf-3749fd7c98dc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Sep 13 16:13:13.993729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 423/851] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:14.592169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:14.592786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:14.594306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:14.594938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:14.600688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:14.601168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:14.601302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:14.601598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:14.601705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:14.602204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:14.602314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:14.602723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:14.602933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:14.603170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:14.603370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:14.603797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:14.633300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b23ab8c9-05b1-477d-ae28-7b57bb558788 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044967 Sep 13 16:13:14.633650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50512409-07f2-4ee9-8d79-eec1d73b95dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Sep 13 16:13:14.634443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 424/852] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:14.634562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 429/853] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:15.005398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:15.007574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:15.013509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:15.013995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:15.014434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:15.015157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:15.015621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:15.016050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:15.046111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ffe8100a-2491-4a61-8b22-ca914fd09f09 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Sep 13 16:13:15.046674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 425/854] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:15.646474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:15.647052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:15.648587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:15.648719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:15.655666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:15.655845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:15.656142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:15.656322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:15.656577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:15.656746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:15.657257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:15.657427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:15.657699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:15.657868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:15.658125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:15.658293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:15.687351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b0a2cfea-81ea-4aeb-9156-82f2a92691f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044758 Sep 13 16:13:15.687773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b8cf9ec-b49b-4e7f-a5a9-737846b41561 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Sep 13 16:13:15.688511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 430/855] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:15.688724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 426/856] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:16.058460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:16.060738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:16.066681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:16.067192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:16.067626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:16.068333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:16.068785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:16.069209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:16.098386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fdbf81b9-dbdc-47f0-9124-3f133558c2b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Sep 13 16:13:16.099173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 431/857] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:16.700418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:16.700973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:16.702495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:16.702611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:16.709075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:16.709266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:16.709559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:16.709679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:16.709994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:16.710106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:16.710694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:16.710789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:16.711177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:16.711298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:16.711601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:16.711697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:16.743276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36350c35-2320-48e8-b22b-feb4b67ef372 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047210 Sep 13 16:13:16.746363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 427/858] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:16.746509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86081f26-fac2-4e8a-90c3-394dd58e8f1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050451 Sep 13 16:13:16.751321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 432/859] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:17.112242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:17.114509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:17.120761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:17.121244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:17.121678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:17.122364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:17.122816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:17.123284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:17.126808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:17.153145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f48c8252-07aa-422b-a917-b8da51849c29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Sep 13 16:13:17.153681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 428/860] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:17.755756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:17.757973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:17.759024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:17.761758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:17.765227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:17.765711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:17.766148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:17.766850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:17.767331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:17.767778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:17.768287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:17.768776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:17.769216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:17.769908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:17.770365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:17.770793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:17.797598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28f24c23-9a5e-47a7-b234-8ed63dcf7b5e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045708 Sep 13 16:13:17.798161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 433/861] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:17.800375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e7705a6-7bc9-43c7-bf7a-21430911ce2a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045449 Sep 13 16:13:17.800935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 429/862] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:18.167729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:18.167729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:18.173574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:18.174057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:18.174491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:18.175243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:18.175695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:18.176124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:18.206626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4d101b5-fb88-43c9-a104-8dcaa285eb7d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 13 16:13:18.207205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 434/863] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:18.810024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:18.812319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:18.813521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:18.815786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:18.818787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:18.819305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:18.819744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:18.820440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:18.820890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:18.821318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:18.821886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:18.822375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:18.823029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:18.823727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:18.824179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:18.824608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:18.851041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a78731f-6765-4978-acbd-e85e629139f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Sep 13 16:13:18.851638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 430/864] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:18.854708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-005193db-90cc-4410-82cf-52a43d2fd8a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045776 Sep 13 16:13:18.855300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 435/865] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:19.219527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:19.221861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:19.228725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:19.229203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:19.229633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:19.230318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:19.230763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:19.231211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:19.260569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54990f66-9590-481a-91ae-da9b27e5dbab tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Sep 13 16:13:19.261109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 431/866] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:19.864774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:19.866922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:19.867059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:19.869666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:19.873536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:19.874018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:19.874450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:19.875179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:19.875627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:19.875924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:19.876076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:19.876398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:19.876827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:19.877512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:19.877957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:19.878412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:19.906118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5edf46f7-6201-4af7-ab01-a3af0d78df82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Sep 13 16:13:19.906687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 436/867] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:19.909882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a635515a-f285-4ca2-9b9c-9dd23cd81c6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046828 Sep 13 16:13:19.910430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 432/868] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:20.272906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:20.275705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:20.281871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:20.282447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:20.282884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:20.283627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:20.284079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:20.284499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:20.314844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-557f2e07-1c1d-4815-8eaa-fcc3f0b65bbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Sep 13 16:13:20.315418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 437/869] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:20.919196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:20.921343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:20.922171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:20.923708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:20.924341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:20.928832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:20.929315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:20.929750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:20.930448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:20.930966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:20.931738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:20.932017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:20.932320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:20.932761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:20.933447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:20.933887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:20.934311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:20.961513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9cc6700c-322f-4b5a-9840-c5bd05538685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Sep 13 16:13:20.961998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 433/870] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:20.963257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e7350c7-4f4e-4368-b418-d46af01133ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044957 Sep 13 16:13:20.963807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 438/871] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:21.327348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:21.329487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:21.335686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:21.336037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:21.336473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:21.337211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:21.337698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:21.338263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:21.372449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1be67ec6-2e50-4c2d-9d54-6f552d4bd221 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049216 Sep 13 16:13:21.373023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 434/872] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:21.974214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:21.975367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:21.976585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:21.977443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:21.983773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:21.984253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:21.984656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:21.984967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:21.985140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:21.985569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:21.985689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:21.986088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:21.986245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:21.986515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:21.986695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:21.987140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:22.016064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1746a95-85d5-4bc6-9c93-da9c66d685da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Sep 13 16:13:22.016280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94a72960-9507-421f-8521-5cfab61b44ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Sep 13 16:13:22.016855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 435/874] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:22.016984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 439/874] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:22.384828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:22.387048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:22.392889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:22.393445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:22.393887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:22.394582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:22.395064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:22.395491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:22.430203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b217d666-94bb-4faa-9a06-45ee93f3acaf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049316 Sep 13 16:13:22.430756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 436/875] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:23.029339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:23.031558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:23.031714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:23.033812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:23.037966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:23.038442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:23.038872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:23.039584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:23.040033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:23.040159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:23.040453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:23.040564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:23.041004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:23.041700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:23.042153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:23.042577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:23.070234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cfede03-0dc3-42c0-bb2c-72ac8655e3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Sep 13 16:13:23.070799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 440/876] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:23.074966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfdb0e27-92b4-49b8-bbfa-27ff101b9c4a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046843 Sep 13 16:13:23.075533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 437/877] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:23.443405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:23.445564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:23.452265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:23.452806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:23.453185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:23.453877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:23.454327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:23.454755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:23.484923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0db6f0d2-d3f1-4319-98a4-7d155d8e0c9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Sep 13 16:13:23.485499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 441/878] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:24.083204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:24.085331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:24.086561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:24.089068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:24.091953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:24.092435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:24.092869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:24.093555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:24.094005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:24.094429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:24.095382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:24.095862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:24.096289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:24.096971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:24.097414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:24.097831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:24.101371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:24.124410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce0e1088-229a-49a3-94ea-9cf6e6f09f28 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Sep 13 16:13:24.124974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 438/879] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:24.128309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78f1dd1a-2d9b-490a-9160-d237116d8b69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045538 Sep 13 16:13:24.128866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 442/880] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:24.497247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:24.499377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:24.505176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:24.505648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:24.506079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:24.506764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:24.507233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:24.507657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:24.552339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31fbc6fd-2d22-4373-914f-177eb476b05c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060077 Sep 13 16:13:24.553027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 439/881] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:25.138150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:25.140330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:25.140918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:25.143027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:25.146692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:25.147205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:25.147644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:25.148340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:25.148787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:25.149211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:25.149318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:25.149684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:25.150134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:25.151479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:25.151936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:25.152358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:25.179494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbf566de-a4e4-462e-accc-2a088f847c93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046250 Sep 13 16:13:25.180058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 443/882] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:25.180861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f0e3d7f-0cd3-42f3-93ab-7f0b6b52ff8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043859 Sep 13 16:13:25.181410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 440/883] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:25.566792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:25.568955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:25.575647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:25.576126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:25.576605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:25.577346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:25.577696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:25.578193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:25.608482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa3fa3bb-a571-4442-8abc-aa3ef8cca80d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Sep 13 16:13:25.609039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 444/884] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:26.191536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:26.193299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:26.193700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:26.195554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:26.200232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:26.200711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:26.201150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:26.201840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:26.201952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:26.202285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:26.202432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:26.202703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:26.202874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:26.203584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:26.204063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:26.204483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:26.233026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-261e55c9-d301-4729-903a-a8de38af1493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Sep 13 16:13:26.233587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 441/885] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:26.235046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a4341c1-9d1a-4f01-8099-882094efa655 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045552 Sep 13 16:13:26.235606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 445/886] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:26.620872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:26.623076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:26.628958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:26.629435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:26.629867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:26.630551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:26.631036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:26.631458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:26.663034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d13a3dc-2f42-4cf2-9d61-1c3f9e67bde9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045991 Sep 13 16:13:26.663581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 442/887] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:27.247642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:27.248285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:27.249797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:27.249989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:27.256277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:27.256437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:27.256745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:27.256858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:27.257174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:27.257292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:27.257853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:27.257960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:27.258298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:27.258396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:27.258717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:27.258867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:27.288642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-27686f33-4e64-4d3f-a9e9-aae7b5d2102c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Sep 13 16:13:27.289075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee1e6007-0da9-40af-9d10-a3c59931ccff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045925 Sep 13 16:13:27.289200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 446/888] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:27.289791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 443/889] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:27.674942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:27.677947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:27.685061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:27.685552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:27.685992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:27.686826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:27.687313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:27.687745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:27.718103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db8a2d79-f8da-4bc1-bd0e-0e957ed1f02e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 Sep 13 16:13:27.718672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 447/890] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:28.301426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:28.302091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:28.303568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:28.303676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:28.309917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:28.310504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:28.310632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:28.310956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:28.311086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:28.311443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:28.311645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:28.312090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:28.312193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:28.312533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:28.312642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:28.313007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:28.339257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:28.342874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ce2f725-a538-4ca0-b1e6-bf0783e66606 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 Sep 13 16:13:28.343471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 448/891] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:28.345525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21c495ed-ea67-4487-927a-6497198ea891 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Sep 13 16:13:28.346084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 444/892] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:28.731473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:28.733661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:28.740829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:28.741347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:28.741791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:28.742494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:28.743146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:28.743582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:28.773113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bb02e17-ce13-416c-b54a-531d17314a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Sep 13 16:13:28.773810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 449/893] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:29.356249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:29.357555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:29.358372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:29.359933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:29.364698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:29.365177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:29.365609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:29.366295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:29.366399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:29.366744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:29.366854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:29.367191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:29.367312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:29.368002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:29.368452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:29.369426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:29.397426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-468f2337-adee-4ea9-97d4-103f955a4ac1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045492 Sep 13 16:13:29.402669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 445/894] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:29.402815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e0c5f53-06e9-4d30-9e2c-e013f6073685 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Sep 13 16:13:29.402815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 450/895] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:29.785839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:29.788033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:29.794303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:29.794777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:29.795239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:29.795928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:29.796371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:29.796797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:29.828459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25fa464c-7e6d-43f7-8491-adddba99b374 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Sep 13 16:13:29.829019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 446/896] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:30.410840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:30.411416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:30.413000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:30.413394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:30.420259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:30.420547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:30.420989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:30.421169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:30.421510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:30.421743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:30.422122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:30.422444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:30.422559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:30.422925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:30.423041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:30.423383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:30.452964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0a1390f-64e8-4cbb-9b10-ea35c14ac8ab tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Sep 13 16:13:30.453216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-066c49e1-112c-4a2d-a800-8f86194f24ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046318 Sep 13 16:13:30.453520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 447/897] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:30.453713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 451/898] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:30.840617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:30.842755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:30.848599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:30.849075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:30.851027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:30.851737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:30.852193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:30.852639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:30.883534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8207eed3-331c-4771-b24d-4e90bfed9ac6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047006 Sep 13 16:13:30.888820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 448/899] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:31.466175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:31.466839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:31.468367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:31.468491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:31.474765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:31.474921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:31.475285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:31.475419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:31.475718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:31.475851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:31.476414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:31.476516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:31.476866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:31.476975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:31.477292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:31.477392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:31.507285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2577bdf8-2a93-4672-ba59-20539d802d8b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Sep 13 16:13:31.507541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b6b1261-99f2-46ca-adba-ddd7f9d802c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045887 Sep 13 16:13:31.508066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 452/900] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:31.508192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 449/901] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:31.896333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:31.898570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:31.904825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:31.905299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:31.905726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:31.906404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:31.906849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:31.907292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:31.947008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d48c216-3c84-4704-a0dd-2e459bc02358 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054694 Sep 13 16:13:31.947878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 453/902] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:32.520129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:32.520769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:32.522170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:32.522305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:32.529221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:32.529698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:32.529805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:32.530124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:32.530235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:32.530659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:32.530809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:32.531275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:32.531394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:32.531695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:32.531793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:32.532202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:32.562128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60a9b578-63db-46de-b78a-b36ae0a2c289 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045905 Sep 13 16:13:32.562701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 450/903] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:32.562998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7616a06d-e875-4eaf-ae7f-27ba9a66172e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Sep 13 16:13:32.563551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 454/904] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:32.959703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:32.961943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:32.968388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:32.968866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:32.969302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:32.969992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:32.970444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:32.970867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:33.012977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-739d99be-7e4e-4481-99e4-3af23efa9c98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057256 Sep 13 16:13:33.013981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 451/905] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:33.575537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:33.576112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:33.577695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:33.577825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:33.584466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:33.584628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:33.584951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:33.585069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:33.585383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:33.585505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:33.586103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:33.586221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:33.586552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:33.586677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:33.587008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:33.587270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:33.617094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-754298d1-189c-4a54-ac06-43fded66e870 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Sep 13 16:13:33.617663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 452/906] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:33.617932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7563afe1-869c-4436-8b53-4811f668b538 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046889 Sep 13 16:13:33.618583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 455/907] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:34.025672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:34.027990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:34.033888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:34.034402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:34.034838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:34.035561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:34.036014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:34.036440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:34.078762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33e9a40a-3f35-4f0c-9439-501bf78c8a46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057130 Sep 13 16:13:34.079399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 453/908] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:34.629618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:34.630323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:34.631761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:34.631888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:34.638348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:34.638503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:34.638820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:34.638969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:34.639280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:34.639391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:34.639958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:34.640065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:34.640403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:34.640511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:34.640816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:34.640913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:34.671634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-604b0e61-ecec-47d7-969c-696e3f8a9575 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045875 Sep 13 16:13:34.672205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 454/909] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:34.672362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61b9895b-82cf-4ebd-98e1-c26c96e48b02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046473 Sep 13 16:13:34.672764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 456/910] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:35.091730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:35.093904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:35.099965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:35.100449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:35.100883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:35.101582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:35.102035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:35.102502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:35.136971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20f4ce4c-b21a-4f69-8f7d-08907117aed0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049904 Sep 13 16:13:35.138028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 455/911] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:35.684440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:35.685038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:35.687148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:35.687411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:35.689454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=78 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:35.694106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:35.694542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:35.694661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:35.695029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:35.695132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:35.695460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:35.695724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:35.696140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:35.696327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:35.696584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:35.696693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:35.697001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:35.725692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-68581f7c-69c1-4402-8888-e80bcfc68a72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Sep 13 16:13:35.726251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 456/912] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:35.728010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56dc8851-aeaa-4720-86ef-4d8cbdcd61fd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047081 Sep 13 16:13:35.728866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 457/913] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:36.150185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:36.152351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:36.159700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:36.160188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:36.160631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:36.161328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:36.161783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:36.162207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:36.194873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8deeded6-fca4-4895-b39b-2f60cc86c07e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049255 Sep 13 16:13:36.195453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 457/914] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:36.739539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:36.740470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:36.741688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:36.742560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:36.749264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:36.749826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:36.750192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:36.751532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:36.752000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:36.752429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:36.756300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:36.756787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:36.757253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:36.757945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:36.758389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:36.758813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:36.782318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-acb7da91-fb71-4ee3-82d1-45d37cc06b3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Sep 13 16:13:36.782909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 458/915] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:13:36.784083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:36.792046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64f04d60-e272-4e4f-9242-9826d5e1f47f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056447 Sep 13 16:13:36.792601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 458/916] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:37.207555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:37.209694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:37.216195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:37.216675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:37.217113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:37.217811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:37.218264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:37.218696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:37.249613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-969ea1ef-332c-4dc1-8f89-6e0417a0ab44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Sep 13 16:13:37.250357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 459/917] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:37.795282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:37.797315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:37.803957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:37.804246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:37.804682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:37.804851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:37.806053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:37.806588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:37.807040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:37.807163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:37.813771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:37.814260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:37.814694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:37.815430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:37.815882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:37.816310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:37.837368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57d14ff3-c7b7-4588-bf2e-59941d89d0fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045896 Sep 13 16:13:37.837945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 459/918] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:37.846087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7e42739-456a-4b5a-8ed6-c3aad9408972 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 13 16:13:37.846638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 460/919] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:38.262081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:38.264577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:38.270020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:38.270496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:38.270953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:38.271635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:38.272082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:38.272503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:38.303591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aeecf819-aeeb-44ee-bd32-34cef77583f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Sep 13 16:13:38.304307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 460/920] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:38.849815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:38.852009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:38.857597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:38.858730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:38.859257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:38.859702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:38.860068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:38.860400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:38.860859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:38.861291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:38.866364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:38.866830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:38.867299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:38.868068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:38.868519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:38.869038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:38.878628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:38.895410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7f120a9-0b1c-4a6b-a54e-a0c0c81981c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049404 Sep 13 16:13:38.898379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 461/921] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:38.902970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7f0381a-8b9a-4339-96b0-34741e57f3d5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049156 Sep 13 16:13:38.903550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 461/922] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:39.316356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:39.318477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:39.325264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:39.325739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:39.326181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:39.326880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:39.327361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:39.327790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:39.358026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13377d03-8750-4046-8540-716ebd147222 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Sep 13 16:13:39.359232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 462/923] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:39.909716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:39.912114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:39.916427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:39.918442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:39.920433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:39.920916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:39.921345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:39.922037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:39.922507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:39.922956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:39.924996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:39.925575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:39.925928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:39.926653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:39.927144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:39.927575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:39.956322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5008b97-b7da-43f3-95d9-06b935b4ced2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050957 Sep 13 16:13:39.956906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 462/924] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:39.966819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ba24360-9e94-449b-bdb0-0001cbcda6bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055499 Sep 13 16:13:39.967435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 463/925] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:40.370242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:40.372471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:40.379180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:40.379694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:40.380102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:40.380793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:40.381240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:40.382016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:40.413458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0566bd27-c059-49fe-af35-fac8180c64c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 Sep 13 16:13:40.414020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 463/926] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:40.968839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:40.971009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:40.977996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:40.978477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:40.978926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:40.979621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:40.980078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:40.980499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:40.981330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:40.983721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:40.989931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:40.990416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:40.990846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:40.991556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:40.992004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:40.992420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:41.010743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e492a9fb-b3be-4d38-9dd4-f562d170a8da tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045834 Sep 13 16:13:41.011339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 464/927] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:41.023010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e92728fa-bcc6-4bc6-98a6-7381cd0adab0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Sep 13 16:13:41.023557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 464/928] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:41.426002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:41.428202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:41.434202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:41.434687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:41.435166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:41.435852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:41.436303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:41.436733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:41.466752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5f97097-f93e-40a5-aa9a-2935a1a61542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Sep 13 16:13:41.467646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 465/929] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:42.023257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:42.025360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:42.031787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:42.032262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:42.032875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:42.033567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:42.034011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:42.034431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:42.035612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:42.037749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:42.044299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:42.044788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:42.045231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:42.045927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:42.046382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:42.046806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:42.066036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5555a464-e203-406e-bfde-7a4a5341fe1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046702 Sep 13 16:13:42.066601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 465/930] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:42.077958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-440939b0-45fd-4299-a6db-708e45026d4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Sep 13 16:13:42.078513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 466/931] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:42.479685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:42.481838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:42.487984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:42.488430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:42.488861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:42.489536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:42.489976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:42.490392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:42.520649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d318d9a4-56f4-4102-ac0c-0d7a9cd713ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Sep 13 16:13:42.521433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 466/932] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:43.079436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:43.081575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:43.088934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:43.089413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:43.089853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:43.090311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:43.090746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:43.091013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:43.091441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:43.092523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:43.098770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:43.099277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:43.099705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:43.100387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:43.100833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:43.101249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:43.121060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7be9bde3-5c76-4f69-9095-b72e90101a20 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045640 Sep 13 16:13:43.121621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 467/933] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:43.130103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c49e528-98b8-4fe9-b3ce-ebd8a2f6508b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Sep 13 16:13:43.130639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 467/934] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:43.533372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:43.535549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:43.541569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:43.542044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:43.542475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:43.543182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:43.543631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:43.544052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:43.574934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9db4ffdf-d531-4b50-b1bc-1dab99f508c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Sep 13 16:13:43.575522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 468/935] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:44.134031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:44.136188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:44.142630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:44.143139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:44.143569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:44.144252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:44.144692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:44.145540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:44.175350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95354483-3edf-4a96-b6a0-fa3db2c4c892 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045674 Sep 13 16:13:44.176121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 468/936] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:44.197577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:44.199888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:44.205773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:44.206251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:44.206685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:44.207413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:44.207861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:44.208286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:44.238440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4f260a6c-6c85-420b-85ae-15a370a75613 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099481 Sep 13 16:13:44.239001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 469/937] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:44.588188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:44.590543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:44.596387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:44.596859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:44.597289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:44.597962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:44.598406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:44.598825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:44.628675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-27795bfe-3f55-4e30-8406-825679570761 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Sep 13 16:13:44.629272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 469/938] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:45.188295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:45.190449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:45.196786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:45.198362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:45.198930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:45.199550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:45.199999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:45.200420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:45.229409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5d5aa70-4be8-4bbf-8e06-c41a6c3f7ce7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045040 Sep 13 16:13:45.229944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 470/939] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:45.250765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:45.252903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:45.260216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:45.260700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:45.261129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:45.261805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:45.262277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:45.262666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:45.291523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b7870541-a775-46a0-8c41-a909863e42f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Sep 13 16:13:45.292076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 470/940] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:45.640950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:45.643112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:45.648945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:45.649423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:45.650530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:45.651134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:45.651589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:45.652015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:45.681972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c953d7eb-1299-470d-890a-3961cc49e901 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044669 Sep 13 16:13:45.682568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 471/941] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:46.242270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:46.244926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:46.250852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:46.251490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:46.251781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:46.252456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:46.252900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:46.253318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:46.284329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-790312d3-2f08-4fd1-b6f6-891100494b21 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046226 Sep 13 16:13:46.284871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 471/942] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:46.303738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:46.305861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:46.312450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:46.312926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:46.313355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:46.314079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:46.314477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:46.314946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:46.344227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45ec6ec0-c981-456a-9393-ea4d0729bdcc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Sep 13 16:13:46.344776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 472/943] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:13:46.693635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:46.695787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:46.702644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:46.703159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:46.703590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:46.704261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:46.704706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:46.705125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:46.734091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8541e681-8f40-4f0e-a8f2-dfebd99af5f4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Sep 13 16:13:46.734637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 472/944] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:47.297598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:47.299741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:47.305637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:47.306746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:47.307252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:47.308053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:47.308505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:47.308931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:47.339644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-448080aa-3fc2-4277-8c2e-c79f57f30a43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046049 Sep 13 16:13:47.340188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 473/945] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:47.356571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:47.358990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:47.365274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:47.365751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:47.366183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:47.366860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:47.367339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:47.367761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:47.397435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f33dfc6-09eb-4132-923c-fccc4be8857c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Sep 13 16:13:47.397983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 473/946] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:47.747337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:47.749433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:47.755504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:47.755977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:47.756410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:47.757091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:47.757539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:47.758032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:47.786675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61a7f580-98e4-4e4f-b22b-a78f634f5129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Sep 13 16:13:47.787249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 474/947] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:48.352114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:48.354278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:48.360452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:48.361043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:48.361341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:48.362013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:48.362455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:48.362872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:48.392754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3fd3760-77c3-4b93-a941-4b18935567e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044537 Sep 13 16:13:48.393309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 474/948] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:48.409697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:48.411886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:48.418335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:48.418815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:48.419278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:48.419963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:48.420415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:48.420839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:48.451043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79bf5c82-27f6-4c37-8003-a54cf2bad3ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Sep 13 16:13:48.451611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 475/949] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:48.799568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:48.801722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:48.808202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:48.808681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:48.809117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:48.809799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:48.810279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:48.810701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:48.826205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:48.842016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4447d29-bf79-4ed2-b1cd-b6b3b3c08702 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046367 Sep 13 16:13:48.842575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 475/950] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:49.405793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:49.407975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:49.414258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:49.414841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:49.415826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:49.416520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:49.416976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:49.417404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:49.446252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b9ca864-46f1-4432-bd7c-d35c81735d82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044493 Sep 13 16:13:49.446806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 476/951] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:49.464327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:49.466532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:49.472904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:49.473384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:49.473825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:49.474510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:49.474987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:49.475419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:49.504832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f07540bc-4625-4c28-84e7-dadbfd2f45ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Sep 13 16:13:49.505379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 476/952] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:49.853781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:49.856008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:49.862263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:49.862750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:49.863221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:49.863918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:49.864374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:49.864807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:49.894237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71e77344-f863-4ed6-ad74-1b85bbf6e837 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Sep 13 16:13:49.894787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 477/953] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:50.458221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:50.460299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:50.466163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:50.466727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:50.467089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:50.467764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:50.468214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:50.468629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:50.498143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6051a80f-2813-4c32-b6a9-b814831a004d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043963 Sep 13 16:13:50.498683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 477/954] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:50.517102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:50.519301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:50.525891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:50.526389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:50.526824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:50.527531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:50.527979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:50.528401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:50.532143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:50.558564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b40c62fe-da4a-457a-8f05-ccd4dfe67c2b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045362 Sep 13 16:13:50.559152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 478/955] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:50.906516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:50.908628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:50.914422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:50.914926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:50.915983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:50.916656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:50.917100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:50.917514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:50.946293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be23ac65-7dbc-4ae7-bade-e00b01b0f269 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Sep 13 16:13:50.946853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 478/956] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:51.511040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:51.513191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:51.515048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=92 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:13:51.520251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:51.520826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:51.521142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:51.521820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:51.522266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:51.522688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:51.552687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f3257d1-c694-4f51-b1bf-9d72dd41882b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046100 Sep 13 16:13:51.553223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 479/957] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:51.570047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:51.572240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:51.578832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:51.579347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:51.579782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:51.580466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:51.580916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:51.581337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:51.611451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4f59cfc-44fb-4784-bf94-1bef0c8c2377 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Sep 13 16:13:51.612006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 479/958] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:51.958886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:51.961021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:51.967648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:51.968126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:51.968556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:51.969292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:51.969737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:51.970156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:52.000011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a87f636e-3dce-42ef-aa5a-9014dd7ca7e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Sep 13 16:13:52.000551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 480/959] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:52.565892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:52.568017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:52.574664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:52.575266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:52.575590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:52.576270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:52.576719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:52.577140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:52.605461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-836222bd-348c-40d0-87fa-187458060822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043578 Sep 13 16:13:52.606001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 480/960] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:52.624037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:52.626242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:52.632599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:52.633096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:52.634142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:52.634848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:52.635333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:52.635765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:52.664128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b9539a2-0afd-4af0-9bcf-6513a9426541 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Sep 13 16:13:52.664674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 481/961] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:53.012824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:53.015031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:53.020990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:53.021480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:53.021923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:53.022613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:53.023105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:53.023536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:53.053081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f370f174-af12-4e4b-93a0-e5149fea1ee4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Sep 13 16:13:53.053634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 481/962] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:53.617083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:53.619260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:53.625539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:53.626145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:53.626436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:53.627144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:53.627593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:53.628014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:53.657764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0daabb8-c107-4587-a552-4a2271583280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044616 Sep 13 16:13:53.658298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 482/963] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:53.676801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:53.679002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:53.685396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:53.685875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:53.686308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:53.687017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:53.687466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:53.687886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:53.717341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dae42140-3a82-4964-ae7b-5d4c159c3e74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Sep 13 16:13:53.717889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 482/964] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:54.066656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:54.068796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:54.075806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:54.076284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:54.076714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:54.077405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:54.077851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:54.078271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:54.107669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-746ab916-2d7b-4e02-b85c-b87fc6b05402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 13 16:13:54.108214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 483/965] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:54.670451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:54.672534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:54.678476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:54.679092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:54.679399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:54.680109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:54.680567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:54.680986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:54.709581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b406532-19e2-460f-83c1-09a2b9b3b42f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043244 Sep 13 16:13:54.710123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 483/966] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:54.730247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:54.732691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:54.739162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:54.739641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:54.740078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:54.740760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:54.741210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:54.741634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:54.769954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ab5d599-c373-4319-a47d-ca4d0cb1f955 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Sep 13 16:13:54.770501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 484/967] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:55.120111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:55.122246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:55.128081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:55.128557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:55.128986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:55.129659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:55.130106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:55.130523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:55.159535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5485c760-39f1-4d39-9e14-c59c0c808ca3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Sep 13 16:13:55.160083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 484/968] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:55.722479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:55.724666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:55.730716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:55.731323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:55.731645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:55.732591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:55.733043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:55.733465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:55.763721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d912c5fb-e561-434c-babc-e9c637946627 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045239 Sep 13 16:13:55.764262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 485/969] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:55.783122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:55.785302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:55.792217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:55.792703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:55.793145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:55.793833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:55.794288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:55.794717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:55.823899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-62b51e54-5957-4f55-aaae-55670461ba89 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Sep 13 16:13:55.824454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 485/970] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:56.171871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:56.174012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:56.179959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:56.180545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:56.181166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:56.181860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:56.182314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:56.182740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:56.210855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6553c30e-7067-4b4c-b27c-d1a638cc8aea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Sep 13 16:13:56.211944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 486/971] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:56.776854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:56.779015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:56.784979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:56.785522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:56.785881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:56.786568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:56.787045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:56.787468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:56.816368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eede7684-eb7d-4933-90e1-ba95f74ae426 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044134 Sep 13 16:13:56.816922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 486/972] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:56.836863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:56.839071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:56.845448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:56.845960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:56.846402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:56.847131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:56.847604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:56.848010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:56.878354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f298b641-3fe3-49f5-8111-ee4017887914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Sep 13 16:13:56.878922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 487/973] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:57.223062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:57.225186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:57.231314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:57.231786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:57.232471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:57.233147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:57.233590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:57.234007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:57.264022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ae11e0fe-da42-425d-a99d-093a376e9974 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Sep 13 16:13:57.264555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 487/974] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:57.829364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:57.831534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:57.838286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:57.838854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:57.839213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:57.839901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:57.840352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:57.840777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:57.870266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c44ef0b6-95b3-4034-b9ff-a73c07bbf881 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044848 Sep 13 16:13:57.870816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 488/975] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:57.890983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:57.893080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:57.900118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:57.900588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:57.901018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:57.901691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:57.902135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:57.902553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:57.932228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12300ea0-b309-483e-a590-b42a894c4806 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 13 16:13:57.932771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 488/976] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:58.277492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:58.279566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:58.285446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:58.285923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:58.286351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:58.287054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:58.287503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:58.287921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:58.317538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34087401-8765-4604-abe9-5e581b956a6c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Sep 13 16:13:58.318078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 489/977] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:58.883830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:58.885917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:58.892083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:58.892698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:58.893044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:58.893866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:58.894351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:58.894851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:58.925224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b8d1a68-b21d-4325-a711-a1dac26080a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046171 Sep 13 16:13:58.925774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 489/978] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:58.944484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:58.947302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:58.953886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:58.954365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:58.954802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:58.955527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:58.955986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:58.956417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:58.986077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2439c2f6-821d-4598-9369-438374577704 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Sep 13 16:13:58.986631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 490/979] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:59.330919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:59.333095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:59.339057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:59.339543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:59.339982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:59.340670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:59.341122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:59.341545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:59.371550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3bfa3ee-5abb-4332-999c-c614b715642f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Sep 13 16:13:59.372101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 490/980] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:13:59.937966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:13:59.940131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:13:59.946098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:59.946647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:59.947044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:59.947740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:13:59.948196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:13:59.948631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:13:59.978734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-124c57bf-8a33-4f0e-a7cc-595d1e7f46a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044914 Sep 13 16:13:59.979354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 491/981] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:13:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:13:59.997746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:00.000176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:00.006384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:00.006857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:00.007317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:00.007994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:00.008550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:00.008973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:00.038536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b24675ed-5aef-471c-9ab7-bf05b881f3d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044716 Sep 13 16:14:00.039984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 491/982] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:13:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:00.383858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:00.386165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:00.391996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:00.392474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:00.392908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:00.393584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:00.394031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:00.394450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:00.424356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6bf7b474-250c-40b5-86d5-079b63f77619 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Sep 13 16:14:00.424910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 492/983] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:00.991530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:00.994364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:01.000261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:01.000847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:01.001154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:01.001952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:01.002402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:01.002822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:01.005585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:01.033348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-74017945-8bbc-4663-89f5-1c4aa7936ccd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045810 Sep 13 16:14:01.033895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 492/984] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:01.053103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:01.055968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:01.062317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:01.062798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:01.063270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:01.064395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:01.064395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:01.064808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:01.093772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3b14c46-4d81-4524-a459-b1a58352998c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Sep 13 16:14:01.094320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 493/985] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:01.436335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:01.438470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:01.444366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:01.444848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:01.445410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:01.446121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:01.446576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:01.447034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:01.476297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b36bf244-c5cc-4f5f-a209-000940f3e4d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Sep 13 16:14:01.477411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 493/986] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:02.045144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:02.047337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:02.053232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:02.053790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:02.054126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:02.054954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:02.055520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:02.055965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:02.081498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:02.087248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb6b20f0-c799-4078-9418-2568694a1822 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046084 Sep 13 16:14:02.087811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 494/987] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:02.105969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:02.108380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:02.114794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:02.115294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:02.115722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:02.116390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:02.116907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:02.117804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:02.147321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b42f7cf2-971f-44a7-83d3-17b9ead3d22c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Sep 13 16:14:02.147861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 494/988] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:02.488948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:02.491132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:02.497598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:02.498077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:02.498514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:02.499242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:02.499695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:02.500151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:02.529090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44f24e1a-598f-4bb1-9c80-bfd1214211fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Sep 13 16:14:02.529635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 495/989] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:03.100347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:03.103133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:03.109341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:03.109928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:03.110251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:03.110960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:03.111411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:03.111839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:03.140686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59865822-1620-4d3b-83c4-b34bfdcfa44d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044344 Sep 13 16:14:03.141228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 495/990] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:03.160682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:03.162823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:03.169842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:03.170322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:03.170761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:03.171495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:03.171955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:03.172381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:03.201110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-700c0d1b-8d0f-424c-b68c-ff4294cb998f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Sep 13 16:14:03.201665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 496/991] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:03.542231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:03.544390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:03.550201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:03.550672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:03.551150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:03.551821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:03.552267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:03.552686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:03.582105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fc771af9-100b-4a2b-8fbc-fbfeac775826 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Sep 13 16:14:03.582646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 496/992] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:04.154268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:04.156423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:04.162424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:04.163000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:04.163351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:04.164067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:04.164534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:04.164959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:04.193709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ccbe4278-19bb-41ac-a8e5-ed9df45b80bb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043566 Sep 13 16:14:04.194258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 497/993] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:04.213500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:04.215662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:04.221924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:04.222408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:04.222841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:04.223543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:04.223992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:04.224415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:04.254059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5236b5df-d413-46ea-a431-b8158c349e87 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Sep 13 16:14:04.256688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 497/994] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:04.594461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:04.596611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:04.603270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:04.603753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:04.604192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:04.604880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:04.605334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:04.605758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:04.634882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfadef47-fc90-417c-b498-68d3d2dc0540 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Sep 13 16:14:04.635459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 498/995] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:05.207066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:05.209173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:05.215191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:05.215752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:05.216084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:05.216753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:05.217196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:05.217614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:05.246538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-877f49a4-2ede-40b8-9193-0891545a191e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043489 Sep 13 16:14:05.247093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 498/996] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:05.266791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:05.268969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:05.275389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:05.275877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:05.276319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:05.277014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:05.277503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:05.277934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:05.307666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40c714be-db77-49c1-9cbf-460902296282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Sep 13 16:14:05.308228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 499/997] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:05.647392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:05.650189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:05.656080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:05.656560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:05.656994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:05.657676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:05.658128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:05.658554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:05.687313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-98c24f04-c52e-41b5-9bf8-c48e1e2cecc6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Sep 13 16:14:05.687858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 499/998] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:06.259945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:06.262135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:06.268360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:06.268916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:06.269270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:06.269965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:06.270422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:06.270854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:06.300521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-feaba23d-5128-4edc-aca7-6cde5d65ed3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045515 Sep 13 16:14:06.301071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 500/999] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:14:06.321493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:06.323594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:06.325881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:06.331139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:06.331614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:06.332044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:06.332716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:06.333167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:06.333582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:06.362906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd4e3823-313b-41b4-9c8c-a16b3b617e65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Sep 13 16:14:06.363500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 500/1000] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:06.700266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:06.702491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:06.708302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:06.708781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:06.709213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:06.709899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:06.711459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:06.711892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:06.743145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fe8cd6d-7a8b-423e-9b15-bea9d97ce4f6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Sep 13 16:14:06.743708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 501/1001] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:07.313858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:07.315899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:07.322758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:07.323357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:07.323682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:07.324356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:07.324800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:07.325219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:07.355592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8294e852-cbe0-4fa3-92ec-94d1ea2a6c44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045792 Sep 13 16:14:07.356136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 501/1002] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:07.375995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:07.378174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:07.385611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:07.386098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:07.386539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:07.387259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:07.387714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:07.388145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:07.417773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2e44bf6-0784-46c9-a61e-c06399958d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Sep 13 16:14:07.418320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 502/1003] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:07.755508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:07.758500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:07.764362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:07.764838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:07.765266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:07.765944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:07.766389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:07.766841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:07.796569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6a1fc63-31f6-4c8d-834b-ff07968e4a9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Sep 13 16:14:07.797107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 502/1004] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:08.368478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:08.370626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:08.377242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:08.377824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:08.378145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:08.379924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:08.380390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:08.380823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:08.410714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ac33be6-eb40-42d4-b413-e6ce7876cf92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046298 Sep 13 16:14:08.411291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 503/1005] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:08.429575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:08.431758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:08.438058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:08.438530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:08.438995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:08.439672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:08.440114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:08.440531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:08.469751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-06395241-d442-4251-bb7d-896a39619574 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Sep 13 16:14:08.470288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 503/1006] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:08.809173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:08.811247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:08.817145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:08.817618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:08.818046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:08.818723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:08.819743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:08.820367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:08.849734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31fabd17-2c1c-4bc0-8945-e5708e5399d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Sep 13 16:14:08.850264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 504/1007] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:09.424255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:09.426393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:09.433227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:09.433801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:09.434136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:09.434793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:09.435264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:09.435684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:09.464236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d6a187a1-df5c-4dc7-be58-24119948115d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044139 Sep 13 16:14:09.464787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 504/1008] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:09.482377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:09.484604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:09.491075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:09.492120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:09.492643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:09.493332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:09.493788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:09.494216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:09.523201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4daeb768-3a56-49d3-92d8-003bfc2a5bb3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Sep 13 16:14:09.523756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 505/1009] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:09.861794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:09.863937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:09.870014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:09.870497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:09.870966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:09.871653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:09.872096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:09.872514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:09.902128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1fb726b8-64d2-4c18-9524-147fddfd855b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Sep 13 16:14:09.902682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 505/1010] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:10.475882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:10.478007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:10.484160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:10.484698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:10.485063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:10.485743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:10.486195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:10.486617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:10.517116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8075d1f-89f8-48ff-84c2-b5709d492a5c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045289 Sep 13 16:14:10.517695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 506/1011] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:10.535553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:10.537647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:10.544089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:10.544562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:10.544997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:10.545669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:10.546112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:10.546529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:10.576099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50b8fd99-d836-4e2f-a189-82d761138751 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Sep 13 16:14:10.576668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 506/1012] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:10.916670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:10.918806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:10.924658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:10.925139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:10.925577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:10.926263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:10.926715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:10.927163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:10.956785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff5fa767-9c21-49a8-9eb2-5621a7e8654f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Sep 13 16:14:10.957334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 507/1013] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:11.529525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:11.531576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:11.537461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:11.538800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:11.538969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:11.539647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:11.540092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:11.540510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:11.569456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0bd08569-6c58-48ef-b5f4-271e06ec4348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043436 Sep 13 16:14:11.569997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 507/1014] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:11.588847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:11.591009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:11.597351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:11.597839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:11.598272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:11.598980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:11.599432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:11.599884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:11.628754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37bd82ae-f147-49da-bd99-7f494d1850bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Sep 13 16:14:11.629296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 508/1015] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:11.969438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:11.971615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:11.978124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:11.978600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:11.979067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:11.979751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:11.980200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:11.980621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:12.005440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:12.011489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36c95185-d261-4f22-953e-169d547cc20d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Sep 13 16:14:12.012042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 508/1016] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:12.581845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:12.583985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:12.590091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:12.590635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:12.591024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:12.591713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:12.592164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:12.592588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:12.623208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4e9fc45-7b07-46c2-a3bf-d9d99d986351 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045327 Sep 13 16:14:12.623754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 509/1017] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:12.641512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:12.643645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:12.650362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:12.650831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:12.651285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:12.651957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:12.652399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:12.652815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:12.681821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48af9bb4-8c92-4788-870b-f41df8d5ba7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Sep 13 16:14:12.682368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 509/1018] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:13.024721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:13.026787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:13.032615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:13.033086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:13.033526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:13.034200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:13.034645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:13.035106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:13.065038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a451ff37-78ab-4e07-8924-399b1a8fb105 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Sep 13 16:14:13.065722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 510/1019] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:13.635546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:13.637671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:13.643712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:13.644275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:13.644620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:13.645305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:13.645757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:13.646182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:13.675060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-242949d8-1225-4425-8172-2db3c058542e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044204 Sep 13 16:14:13.675611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 510/1020] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:13.693548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:13.696634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:13.702942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:13.703407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:13.703841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:13.704545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:13.704993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:13.705415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:13.722339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:13.736395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1c6f65d-ac1e-46f4-a915-449c4a5c4af8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046764 Sep 13 16:14:13.736947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 511/1021] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:14.078640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:14.080797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:14.086715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:14.087227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:14.087659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:14.088340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:14.088786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:14.089207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:14.118760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cad10c40-8b7f-445c-bb8d-c65d869684b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044049 Sep 13 16:14:14.119354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 511/1022] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:14.688522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:14.690655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:14.697550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:14.698099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:14.698457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:14.699174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:14.699631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:14.700058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:14.729989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55155e29-2924-4f02-9b12-16e572d4bea3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045429 Sep 13 16:14:14.730531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 512/1023] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:14.749474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:14.751659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:14.758712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:14.759219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:14.759648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:14.760331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:14.760784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:14.761202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:14.790339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3552deda-9f7c-43af-96a1-dac6097b5ac6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Sep 13 16:14:14.790884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 512/1024] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:15.132079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:15.134346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:15.140243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:15.140721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:15.141151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:15.141832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:15.142280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:15.142698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:15.172077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03a79007-7028-4170-99a1-4b3bda63332f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Sep 13 16:14:15.172629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 513/1025] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:15.744005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:15.746138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:15.752932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:15.753512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:15.753827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:15.754510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:15.754983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:15.755405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:15.784795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4892dd9c-33de-4955-a59b-b8af9d51e28c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045406 Sep 13 16:14:15.785343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 513/1026] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:15.801868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:15.804594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:15.811174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:15.811660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:15.812126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:15.812934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:15.813395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:15.813850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:15.843289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e955e453-45c4-421d-b3bf-9bf88f60b0f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Sep 13 16:14:15.843835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 514/1027] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:16.184391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:16.186596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:16.192492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:16.192975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:16.193519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:16.194362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:16.194818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:16.195274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:16.226016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22b4128c-aab1-4ccb-be07-68f78090e1ea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045518 Sep 13 16:14:16.226574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 514/1028] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:16.797420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:16.799492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:16.805662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:16.806294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:16.806546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:16.807251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:16.807697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:16.808117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:16.838454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8702cd48-5839-4354-8364-2b9b7d27d053 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045136 Sep 13 16:14:16.839051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 515/1029] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:16.855849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:16.857975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:16.864619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:16.865103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:16.865531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:16.866211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:16.866653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:16.867109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:16.897425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-625ddb09-01ee-4cdd-8b4f-80e9668e1b53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Sep 13 16:14:16.898053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 515/1030] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:17.238684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:17.241367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:17.247247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:17.247733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:17.248203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:17.248892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:17.249348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:17.249780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:17.279161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-460a9c4a-ff84-40dd-94c3-ef7025b55f17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Sep 13 16:14:17.279709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 516/1031] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:17.851649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:17.853785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:17.859937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:17.860496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:17.860828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:17.861502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:17.861964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:17.862368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:17.892325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73e4377e-2744-4178-bcd7-990dc3f4b69f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045455 Sep 13 16:14:17.892864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 516/1032] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:17.909595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:17.911735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:17.919183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:17.919665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:17.920096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:17.920777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:17.921223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:17.921643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:17.950050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3814c825-0720-467a-ba51-cf945a488108 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Sep 13 16:14:17.950596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 517/1033] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:18.292253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:18.294402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:18.300276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:18.300748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:18.301175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:18.301847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:18.302291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:18.302958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:18.338959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50f32b0f-bda9-4c08-8436-533abddb1767 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050661 Sep 13 16:14:18.339506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 517/1034] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:18.905788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:18.907957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:18.913904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:18.914487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:18.914843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:18.915554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:18.916007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:18.916436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:18.946383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56bf79bb-bbcd-4e3f-83ae-65dd915dc8d1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044578 Sep 13 16:14:18.946947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 518/1035] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:18.961657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:18.963863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:18.971109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:18.971775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:18.972298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:18.972921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:18.973373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:18.973795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:19.003481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9935d999-3934-448b-9e8b-42e98bc1e930 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Sep 13 16:14:19.004037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 518/1036] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:19.351873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:19.354012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:19.360104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:19.360587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:19.361022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:19.361735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:19.362187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:19.362611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:19.391888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a360be3c-6f32-414a-8101-a7f07ecfe6d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Sep 13 16:14:19.392433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 519/1037] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:19.958394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:19.961426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:19.967357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:19.968042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:19.968264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:19.968940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:19.969385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:19.969805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:19.998926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76b7a180-505a-4af4-a63a-7338df241c24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044462 Sep 13 16:14:19.999462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 519/1038] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:20.016365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:20.018500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:20.025896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:20.026382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:20.027184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:20.027873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:20.028323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:20.028751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:20.057501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-94ae50fd-56a8-441f-a0f2-06193ec2cae1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Sep 13 16:14:20.058079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 520/1039] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:20.404477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:20.406594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:20.412535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:20.413014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:20.413451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:20.414131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:20.414582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:20.415039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:20.444529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3d62cac-36fb-4271-8d9e-749d22959aaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Sep 13 16:14:20.445075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 520/1040] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:21.012092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:21.014107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:21.020015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:21.020583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:21.020910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:21.022538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:21.023023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:21.023449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:21.053783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7b03bf7-5483-4010-88f0-e8b0cb725526 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045693 Sep 13 16:14:21.054339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 521/1041] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:21.069593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:21.071945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:21.078363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:21.078847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:21.079319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:21.080007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:21.080459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:21.080887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:21.111551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94c2ca95-b85f-4aa8-bdf4-243239a8a53a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Sep 13 16:14:21.112391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 521/1042] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:21.457242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:21.459612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:21.465855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:21.466332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:21.466770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:21.467531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:21.467980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:21.468430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:21.498693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cf8e1fe-e9d4-4c68-869f-1eaa9422349f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Sep 13 16:14:21.499266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 522/1043] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:22.065740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:22.068420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:22.074526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:22.075093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:22.075501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:22.076181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:22.076631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:22.077054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:22.107380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-04214cac-5d7a-44f9-86ac-b5c58516e0b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045541 Sep 13 16:14:22.108142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 522/1044] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:22.123733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:22.125877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:22.128269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:22.134333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:22.134814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:22.135283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:22.135976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:22.136433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:22.136862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:22.167257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-950032b3-d905-4170-be5d-df7d52e1897d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Sep 13 16:14:22.167807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 523/1045] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:22.511759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:22.513923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:22.519861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:22.520344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:22.520806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:22.521497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:22.521944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:22.522363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:22.550683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-268c5849-c6e2-4376-b6fa-7effc7ce0fad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Sep 13 16:14:22.551259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 523/1046] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:23.120777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:23.122989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:23.129315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:23.129878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:23.130314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:23.131082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:23.131537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:23.131969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:23.161273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8bc6b73-6883-4951-873e-9877438bd466 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044543 Sep 13 16:14:23.162600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 524/1047] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:14:23.179206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:23.181393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:23.187855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:23.188342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:23.188788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:23.189476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:23.189929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:23.190357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:23.219061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1741fcec-f47d-43d0-b30e-d597ea301da9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Sep 13 16:14:23.219607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 524/1048] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:23.563146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:23.565312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:23.571853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:23.572336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:23.572778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:23.573466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:23.573925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:23.574351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:23.603898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c62d0d6-75d9-4154-9b00-367517862127 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Sep 13 16:14:23.604442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 525/1049] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:24.174583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:24.176702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:24.183437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:24.184007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:24.184332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:24.185007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:24.185452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:24.185868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:24.200839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:24.217162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66ffe6a9-8bad-4c99-a20a-0398d2e005fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046526 Sep 13 16:14:24.217705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 525/1050] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:24.231695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:24.233912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:24.240901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:24.241384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:24.241822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:24.242510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:24.242989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:24.243418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:24.273667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d10b693b-b6bd-47d9-a374-1af6d7ffdbef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Sep 13 16:14:24.274216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 526/1051] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:24.617427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:24.619647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:24.625513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:24.625932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:24.626362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:24.627067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:24.627510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:24.627929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:24.657311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6811d2c-9243-4fcd-92f8-9e391f34aecf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Sep 13 16:14:24.657858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 526/1052] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:25.229419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:25.231735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:25.238169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:25.238641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:25.239110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:25.240160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:25.240833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:25.241258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:25.270391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-059881f4-b774-4951-8715-76031bb68d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044998 Sep 13 16:14:25.271673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 527/1053] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:25.285691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:25.287910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:25.294257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:25.294741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:25.295229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:25.295923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:25.296377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:25.296807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:25.327143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66437ab8-f5c5-42b2-8550-dbb3bcf7add4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Sep 13 16:14:25.327707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 527/1054] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:25.670752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:25.673047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:25.679651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:25.680134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:25.680574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:25.681301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:25.681758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:25.682186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:25.685875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:25.713172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d41c13f2-a339-4c5e-8f17-f9d9db4c9148 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Sep 13 16:14:25.713941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 528/1055] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:26.283768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:26.285865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:26.293094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:26.293569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:26.294003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:26.294685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:26.295166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:26.295590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:26.324186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c6d6f52-cbef-4a9a-b517-e2cfe18f9130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044519 Sep 13 16:14:26.324744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 528/1056] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:26.340256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:26.342445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:26.349374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:26.349852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:26.350290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:26.350996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:26.351450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:26.351873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:26.380586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9fc021f3-1c95-4534-9076-f361d31bc825 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Sep 13 16:14:26.381133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 529/1057] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:26.725781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:26.727959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:26.734027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:26.734504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:26.734970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:26.735650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:26.736103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:26.736526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:26.766071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36a2cdfd-4422-48c3-b781-041bd926ba05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Sep 13 16:14:26.766631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 529/1058] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:27.336805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:27.338968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:27.344954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:27.345530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:27.345851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:27.346533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:27.347017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:27.347443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:27.377694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b37fe13e-5c37-47aa-abd4-0fae5cf9a9b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044902 Sep 13 16:14:27.378245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 530/1059] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:27.392826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:27.394992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:27.401652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:27.402129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:27.402557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:27.403259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:27.403705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:27.404126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:27.433340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76ca1c19-0e23-48d8-8c03-8654c0f69d53 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Sep 13 16:14:27.433884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 530/1060] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:27.779512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:27.781600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:27.788633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:27.789116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:27.789549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:27.790236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:27.790680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:27.791133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:27.818885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0194837a-7142-41a0-a19a-893a28d6f995 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043562 Sep 13 16:14:27.819501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 531/1061] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:28.390222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:28.392382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:28.399654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:28.400216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:28.400558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:28.401252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:28.401700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:28.402127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:28.432138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-91903a07-45ab-4799-9e2c-29a9aeaf3897 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045843 Sep 13 16:14:28.432714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 531/1062] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:28.446636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:28.448782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:28.455107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:28.455591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:28.456025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:28.456710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:28.457161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:28.457588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:28.486624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0179f1c-bad2-4cb5-8f10-0d2b5246641b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Sep 13 16:14:28.487219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 532/1063] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:28.831304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:28.833703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:28.839595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:28.840066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:28.840497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:28.841175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:28.841620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:28.842039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:28.871749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e60eeff3-064f-4426-a43d-918790df1cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Sep 13 16:14:28.872292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 532/1064] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:29.445404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:29.447544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:29.453646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:29.454125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:29.454558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:29.455268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:29.455748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:29.456175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:29.485163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-edf5b9af-0385-46a3-8ed1-dc69d201cf68 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044557 Sep 13 16:14:29.485704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 533/1065] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:29.499220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:29.501383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:29.508239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:29.508716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:29.509143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:29.509818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:29.510264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:29.510683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:29.539221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51409556-0911-4aa0-8c1c-4461e757d12b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Sep 13 16:14:29.539760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 533/1066] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:29.883427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:29.885659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:29.891915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:29.892391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:29.892825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:29.893516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:29.893963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:29.894389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:29.923353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-488a46a3-80ed-45ca-bd4f-4630c2475966 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Sep 13 16:14:29.923897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 534/1067] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:30.497909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:30.499988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:30.506509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:30.507031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:30.507473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:30.508167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:30.508620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:30.509049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:30.538942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd758904-85f6-44a3-b1f5-f2f5c50ce172 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045079 Sep 13 16:14:30.539500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 534/1068] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:30.551387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:30.553533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:30.559886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:30.560361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:30.560794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:30.561479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:30.561931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:30.562356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:30.591761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a907a15-ca31-40c9-b307-eda1e2e825bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Sep 13 16:14:30.592302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 535/1069] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:30.936293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:30.938460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:30.944900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:30.945376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:30.945809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:30.946484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:30.947035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:30.947377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:30.976254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e85b43e4-c914-4d79-b588-5ddf351bab31 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Sep 13 16:14:30.976795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 535/1070] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:31.551008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:31.553681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:31.559736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:31.560208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:31.560645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:31.561339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:31.561788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:31.562210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:31.590386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-01b65654-3fb1-490e-b825-c07e671e59fc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043463 Sep 13 16:14:31.590951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 536/1071] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:31.604956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:31.607091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:31.613375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:31.613849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:31.614328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:31.615829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:31.616278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:31.616700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:31.644912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ead0f91a-ca59-4e46-b957-be6c26ddf66c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Sep 13 16:14:31.645457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 536/1072] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:31.989059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:31.991542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:31.997807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:31.998283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:31.998715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:31.999431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:31.999874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:32.000294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:32.030064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-530f0c72-5e35-4ca6-8090-e040fd4b7fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Sep 13 16:14:32.030610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 537/1073] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:32.602860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:32.605314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:32.611649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:32.612126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:32.612552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:32.613227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:32.613671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:32.614087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:32.642421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6668868f-7d62-4792-9627-33c4dce62207 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043624 Sep 13 16:14:32.642975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 537/1074] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:32.657282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:32.659560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:32.665953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:32.666429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:32.666923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:32.667615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:32.668104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:32.668531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:32.698282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c7f0979-46bc-47b0-b9bf-2fca4f0d8f3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Sep 13 16:14:32.698837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 538/1075] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:33.042330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:33.044418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:33.050375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:33.050862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:33.051330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:33.052848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:33.053308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:33.053740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:33.082975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43407035-8cb6-42b8-ba1f-e062152564d1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Sep 13 16:14:33.083699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 538/1076] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:33.655556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:33.657669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:33.664086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:33.664563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:33.665002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:33.665681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:33.666129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:33.666551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:33.695873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44e655e3-8095-4d86-b013-0422eab90415 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044282 Sep 13 16:14:33.696415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 539/1077] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:33.709714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:33.711879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:33.718087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:33.718601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:33.719085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:33.719776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:33.720226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:33.720662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:33.751348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ea9b434-270c-4e61-9357-3748d1b3bbd8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 13 16:14:33.751898 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 539/1078] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:34.095472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:34.097615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:34.104019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:34.104759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:34.105192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:34.105870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:34.106318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:34.106736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:34.135995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec5247a1-d999-4b23-8d2a-398bef81fa24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Sep 13 16:14:34.136526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 540/1079] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:34.709177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:34.711221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:34.717342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:34.717811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:34.718239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:34.718937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:34.719387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:34.719808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:34.748497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49c35ca0-c375-44c6-94ce-526b70174859 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044017 Sep 13 16:14:34.749036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 540/1080] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:34.763647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:34.765823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:34.773095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:34.773570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:34.774001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:34.774720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:34.775195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:34.775614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:34.804461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28eb418e-0e1f-4e62-8a7b-b3dde181d56e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044669 Sep 13 16:14:34.805004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 541/1081] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:35.148856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:35.150979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:35.156778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:35.157248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:35.157676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:35.158347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:35.158790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:35.159230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:35.188664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81f68371-2759-492d-9c9f-58b9aad350e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Sep 13 16:14:35.189218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 541/1082] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:35.761349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:35.763421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:35.769808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:35.770917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:35.771358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:35.772038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:35.772506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:35.772911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:35.801562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6797d6b8-9503-4345-b9c4-dd4445ecdacd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044304 Sep 13 16:14:35.802106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 542/1083] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:35.817204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:35.819475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:35.825794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:35.826272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:35.826710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:35.827442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:35.827891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:35.828313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:35.830625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:35.859979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-883891f9-be90-49f7-9cb3-04a0043a1c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Sep 13 16:14:35.861047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 542/1084] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:36.201084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:36.203239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:36.210169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:36.210655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:36.211125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:36.211824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:36.212276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:36.212731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:36.241641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e8e1a28-007d-41a1-9c60-e6cb576c88d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 13 16:14:36.242186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 543/1085] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:36.814249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:36.816366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:36.818491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:36.824050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:36.824522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:36.824984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:36.825662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:36.826107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:36.826525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:36.855932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5f6dbe1-a37c-4d9d-89b4-7db9fea37b55 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045719 Sep 13 16:14:36.856471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 543/1086] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:14:36.873375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:36.875601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:36.882278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:36.882757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:36.883217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:36.883902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:36.884353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:36.884777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:36.908966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:36.914715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4d0b93e-c6bb-4bed-ac47-7f0298e1f207 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Sep 13 16:14:36.915298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 544/1087] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:37.253601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:37.256111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:37.261973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:37.262449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:37.262875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:37.263570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:37.264013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:37.264432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:37.294417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-869e8209-1965-49d0-bd93-84c175bdf739 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Sep 13 16:14:37.294981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 544/1088] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:37.870651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:37.872757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:37.878550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:37.879126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:37.880176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:37.881037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:37.881484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:37.881904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:37.911654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbd5b747-ecc0-4894-b33f-8cdb4b512e66 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045256 Sep 13 16:14:37.912199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 545/1089] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:37.927670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:37.929782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:37.936210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:37.936684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:37.937115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:37.937793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:37.938238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:37.938657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:37.967640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e727b7e-23c3-40b2-a282-ea6360008c15 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Sep 13 16:14:37.968178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 545/1090] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:38.307407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:38.309470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:38.315372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:38.315847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:38.316285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:38.317092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:38.317536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:38.317961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:38.346360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfc5f0e4-84ad-4d9f-b267-3639ef779fd6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Sep 13 16:14:38.346914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 546/1091] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:38.923603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:38.925623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:38.932519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:38.933116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:38.933406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:38.934080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:38.934522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:38.934965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:38.965138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed1e1e78-3703-4ac7-af72-8d3f408215b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045576 Sep 13 16:14:38.965672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 546/1092] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:38.980261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:38.982403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:38.989357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:38.989850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:38.990286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:38.991006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:38.991457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:38.991881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:39.021774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3d1b4a5-9281-4082-b300-0466da11b9d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Sep 13 16:14:39.022316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 547/1093] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:39.359405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:39.361562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:39.368025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:39.368499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:39.368927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:39.369604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:39.370049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:39.370467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:39.399290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-40a34ce9-176d-401a-b690-751c377fe952 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Sep 13 16:14:39.399828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 547/1094] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:39.979153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:39.981203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:39.988148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:39.989291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:39.989720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:39.990410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:39.990856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:39.991298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:40.023451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24991680-1672-43c7-885d-6c57e57a55f4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048928 Sep 13 16:14:40.024010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 548/1095] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:14:40.033726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:40.036440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:40.042562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:40.043097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:40.043539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:40.044249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:40.044707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:40.045135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:40.077390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6805a5df-41be-47fd-b743-6b6a48cabb7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047632 Sep 13 16:14:40.077963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 548/1096] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:40.412251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:40.414402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:40.420403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:40.420911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:40.421305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:40.422007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:40.423533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:40.423975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:40.454446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7229480e-df2b-4807-8b3e-4fa56afd9f3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047252 Sep 13 16:14:40.455031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 549/1097] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:41.036873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:41.038937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:41.045476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:41.045953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:41.046387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:41.047104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:41.047560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:41.047973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:41.078206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c17b1288-ec7a-4f55-a5e6-c61b8a29829c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045374 Sep 13 16:14:41.078752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 549/1098] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:41.089499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:41.091665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:41.098089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:41.098778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:41.099236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:41.099919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:41.100396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:41.100820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:41.130877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-060f081b-a4f7-44d0-8ee3-4a82255990fc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Sep 13 16:14:41.131431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 550/1099] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:41.467376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:41.469670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:41.476280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:41.476773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:41.477193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:41.477878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:41.478330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:41.479026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:41.507807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c849fa31-04ee-4074-8595-f1c68d49f258 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Sep 13 16:14:41.508359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 550/1100] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:42.091108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:42.093266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:42.099805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:42.100278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:42.100710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:42.101392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:42.101841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:42.102265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:42.131477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88e1fd54-521c-465b-a1b4-4aef70dc6326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044400 Sep 13 16:14:42.132009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 551/1101] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:42.142376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:42.145230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:42.151576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:42.152052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:42.152483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:42.153166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:42.153617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:42.154039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:42.182586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-97e1d2d9-4572-4eb2-a2c1-c2561548a755 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Sep 13 16:14:42.183168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 551/1102] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:42.519263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:42.521472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:42.527344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:42.527822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:42.528260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:42.528939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:42.529387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:42.529811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:42.558564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-653e298f-c450-4f31-a9bf-ad3a78c864ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 Sep 13 16:14:42.559152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 552/1103] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:43.144927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:43.147312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:43.153565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:43.154035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:43.154466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:43.155162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:43.155608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:43.156026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:43.184854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6075ba89-3934-45db-8867-62bbfd02dcb5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044655 Sep 13 16:14:43.185404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 552/1104] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:14:43.194770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:43.196927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:43.203330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:43.203809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:43.204267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:43.204951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:43.205400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:43.205825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:43.235435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0e50bf4-b03a-437d-a0f1-f1ff2662074a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Sep 13 16:14:43.235983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 553/1105] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:43.571694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:43.573803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:43.579706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:43.580187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:43.580622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:43.581305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:43.581754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:43.582175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:43.611165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34e5208c-1804-4c09-bb9d-bc59b70e03f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Sep 13 16:14:43.611711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 553/1106] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:44.198014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:44.200097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:44.206397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:44.206870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:44.207359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:44.208084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:44.208534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:44.208950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:44.237486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-53040d23-0778-4409-ad29-fd1a1c867ab6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043528 Sep 13 16:14:44.238030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 554/1107] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:44.248152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:44.250254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:44.257487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:44.257962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:44.258394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:44.259110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:44.259559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:44.259976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:44.289266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3091e82a-bc44-485c-8a68-22aad6a8a79c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044993 Sep 13 16:14:44.289814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 554/1108] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:44.624127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:44.626244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:44.632235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:44.632717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:44.633148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:44.633833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:44.634284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:44.634709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:44.663927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c7f4e89-0203-4d48-8cde-7ca4fbde91ec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Sep 13 16:14:44.664468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 555/1109] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:45.249697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:45.251756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:45.258674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:45.259186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:45.259720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:45.260402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:45.260845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:45.261262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:45.290054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ec10d6d-f2d1-4b22-8c5e-d8a1b26424b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044361 Sep 13 16:14:45.290625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 555/1110] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:45.301477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:45.303729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:45.310100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:45.310586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:45.311056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:45.311747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:45.312203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:45.312635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:45.342319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-acbbf12f-ee75-4536-87c3-d538002f1a00 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Sep 13 16:14:45.342875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 556/1111] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:45.676140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:45.678502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:45.684343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:45.684813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:45.685241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:45.685912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:45.686356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:45.686775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:45.715461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7550b07-be06-416b-bf86-f0ac0f051100 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 Sep 13 16:14:45.716263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 556/1112] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:46.302534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:46.304718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:46.311171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:46.311645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:46.312078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:46.312760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:46.313210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:46.313633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:46.342457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8962c3d8-54f5-4d6b-9304-b378a965f215 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Sep 13 16:14:46.342944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 557/1113] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:46.355409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:46.357566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:46.364237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:46.364718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:46.365148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:46.365833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:46.366488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:46.367119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:46.397159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b64d8d7-179d-45e7-bd75-5bda8b7fc2c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047561 Sep 13 16:14:46.398651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 557/1114] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:46.728011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:46.730835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:46.736716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:46.737191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:46.737623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:46.738303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:46.738748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:46.739198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:46.768366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ceffbb2-d2b0-4ea1-b404-c1a612246716 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Sep 13 16:14:46.769531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 558/1115] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:47.355335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:47.357480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:47.363596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:47.364078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:47.364515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:47.365198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:47.365648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:47.366139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:47.391038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:47.396318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56ee828a-8141-46ae-846d-4317341f8cff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045431 Sep 13 16:14:47.396894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 558/1116] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:47.409491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:47.411661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:47.418242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:47.418734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:47.419215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:47.419928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:47.420383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:47.420812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:47.450320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dab989a2-889f-47c6-97f1-ce8916b2e982 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Sep 13 16:14:47.450866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 559/1117] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:47.782356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:47.784932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:47.790733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:47.791238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:47.791673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:47.792351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:47.792796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:47.793214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:47.823228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0edf449a-2f63-4ab6-a14f-3c7a819e5f88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Sep 13 16:14:47.823770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 559/1118] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:48.409632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:48.411850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:48.418909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:48.419402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:48.419847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:48.420539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:48.420998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:48.421424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:48.450123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17de3f7a-45f1-4b6e-9345-f00d3033b3cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044472 Sep 13 16:14:48.450678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 560/1119] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:48.462775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:48.464961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:48.471299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:48.471783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:48.472224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:48.472914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:48.473372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:48.473799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:48.503333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9383e869-fd31-47ff-918c-3f654946e4cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Sep 13 16:14:48.503872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 560/1120] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:48.836299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:48.838441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:48.844646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:48.845124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:48.845558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:48.846297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:48.846747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:48.847194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:48.864097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:48.877965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3bfb13e-dd67-4046-80fe-1c408a16bcbd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Sep 13 16:14:48.878543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 561/1121] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:49.462658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:49.464718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:49.470787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:49.471296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:49.471736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:49.472421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:49.472873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:49.473299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:49.503202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2614252e-fb1e-40fb-9863-127fde7da838 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044586 Sep 13 16:14:49.503751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 561/1122] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:49.515726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:49.517875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:49.524278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:49.524755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:49.525187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:49.525870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:49.526321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:49.526749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:49.556059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f645f2f-aa3f-42ce-922d-93f7c78857fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Sep 13 16:14:49.556609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 562/1123] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:49.890247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:49.892513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:49.899288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:49.899769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:49.900196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:49.900871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:49.901317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:49.901734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:49.932202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a95bdc63-525e-4f83-8788-f4c2cfcd220b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045913 Sep 13 16:14:49.932739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 562/1124] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:50.515911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:50.517975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:50.524716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:50.525191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:50.525624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:50.526314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:50.526763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:50.527214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:50.555389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65e8601c-2342-454c-a198-181e8a6881ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043615 Sep 13 16:14:50.555931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 563/1125] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:50.569521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:50.571821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:50.578128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:50.578607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:50.579085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:50.579772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:50.580223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:50.580648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:50.610268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3965731-6309-4258-9eb0-279f07b44bd9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Sep 13 16:14:50.610809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 563/1126] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:50.945344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:50.947470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:50.953254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:50.953726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:50.954154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:50.954831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:50.955303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:50.955727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:50.984831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6037e44b-b1f3-46c0-a6c8-29ec4690d75b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Sep 13 16:14:50.985366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 564/1127] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:51.567390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:51.570260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:51.576605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:51.577087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:51.577521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:51.578203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:51.578653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:51.579123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:51.607653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db0d8e2e-d7af-485e-bdd4-2516571053be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044325 Sep 13 16:14:51.608192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 564/1128] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:51.622014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:51.624458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:51.630777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:51.631959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:51.632399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:51.633092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:51.633549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:51.633977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:51.662558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-826f4cf9-c059-4e8a-b4c7-9b836f0ac761 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Sep 13 16:14:51.663144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 565/1129] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:51.997713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:51.999826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:52.005729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:52.006234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:52.006677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:52.007393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:52.007852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:52.008283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:52.036662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e4d78ac9-1536-4d3e-8bc4-e299aa5ceb7f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Sep 13 16:14:52.037712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 565/1130] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:52.620765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:52.622780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:52.624648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:52.630260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:52.630731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:52.631307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:52.632078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:52.632525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:52.633216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:52.661867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1703d282-17d4-4e05-9d97-1af6840eb8be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045331 Sep 13 16:14:52.663085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 566/1131] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:52.674808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:52.676995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:52.684051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:52.684540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:52.684986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:52.685675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:52.686126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:52.686556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:52.715360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4f9d26b-12ca-4a6e-97fe-2b5595ab57a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Sep 13 16:14:52.715912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 566/1132] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:53.049747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:53.051813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:53.058720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:53.059232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:53.059661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:53.060436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:53.060882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:53.061302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:53.091432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50b082b5-f864-4e16-a171-9cec20be2c02 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Sep 13 16:14:53.091979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 567/1133] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:53.675002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:53.677069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:53.683387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:53.683859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:53.684286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:53.684961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:53.685402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:53.685819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:53.715139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49a8f4bc-883b-4180-8499-f04a6b956ec5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044139 Sep 13 16:14:53.715683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 567/1134] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:53.728543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:53.730711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:53.737081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:53.737560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:53.738002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:53.738688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:53.739164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:53.739595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:53.768469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed18c397-3a9d-4606-8476-fda76340f2ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Sep 13 16:14:53.769013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 568/1135] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:54.104283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:54.106429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:54.112295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:54.112777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:54.113211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:54.113895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:54.114342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:54.114765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:54.143462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-355d37fa-c819-4524-98f7-8ed0182d5faf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Sep 13 16:14:54.144004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 568/1136] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:54.728096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:54.730185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:54.736241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:54.736719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:54.737153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:54.737837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:54.738288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:54.738717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:54.768862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c51a0063-5990-4359-990f-b437370e52b3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045242 Sep 13 16:14:54.769409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 569/1137] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:54.781299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:54.783475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:54.789752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:54.790220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:54.790648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:54.791350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:54.791794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:54.792224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:54.820914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10788a41-7963-4336-b1e0-81a1ae8ce5a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Sep 13 16:14:54.821460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 569/1138] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:55.156641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:55.159045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:55.165880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:55.166353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:55.167145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:55.167866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:55.168312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:55.168735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:55.199101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3da42c73-33e7-474b-8f21-2cc1aac9e7b2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Sep 13 16:14:55.199638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 570/1139] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:55.781697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:55.783780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:55.790441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:55.790932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:55.791361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:55.792036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:55.792478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:55.792893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:55.821631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e70fefa5-39ac-42f6-8ee9-fac2ffe9c516 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043928 Sep 13 16:14:55.822190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 570/1140] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:55.833108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:55.836007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:55.842436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:55.842946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:55.843393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:55.844086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:55.844543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:55.844967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:55.876757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a7e784a-a954-45a1-b6a5-7d152b063896 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Sep 13 16:14:55.877312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 571/1141] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:56.211962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:56.214089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:56.220128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:56.220610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:56.221050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:56.221735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:56.222189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:56.222614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:56.250846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-246305ef-bebe-4e80-801c-7e647b69a6f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Sep 13 16:14:56.251429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 571/1142] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:56.834244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:56.836308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:56.842423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:56.842890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:56.843348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:56.844024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:56.844466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:56.844884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:56.874051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-117a98ba-04d8-47dd-95be-c0753f2d9e3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043837 Sep 13 16:14:56.874593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 572/1143] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:56.888578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:56.890723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:56.897436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:56.897913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:56.898346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:56.899054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:56.899504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:56.899924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:56.928959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-269a8eae-762f-4d8b-9b6b-0df68f6f4c84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Sep 13 16:14:56.929501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 572/1144] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:57.263209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:57.265254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:57.271154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:57.271802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:57.272046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:57.272721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:57.273167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:57.273588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:57.303238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24d5cde5-1e15-419e-8b13-4963553f3725 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Sep 13 16:14:57.303765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 573/1145] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:57.887060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:57.889102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:57.895732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:57.896907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:57.897338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:57.898017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:57.898460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:57.898878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:57.928330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f91ebf0-614e-4fea-b56b-0199a0efb97c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045559 Sep 13 16:14:57.928864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 573/1146] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:57.941427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:57.944366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:57.950615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:57.951104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:57.951536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:57.952214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:57.952660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:57.953077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:57.982780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-508357a2-ff41-422f-b7bd-bea5e57d04ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Sep 13 16:14:57.983353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 574/1147] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:14:58.315777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:58.317843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:58.324254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:58.324731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:58.325158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:58.325832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:58.326274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:58.326690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:58.355229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-031b6e4e-b9f2-4a1d-b3fb-e58180a2d6da tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Sep 13 16:14:58.355773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 574/1148] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:58.940303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:58.942502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:58.948860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:58.949333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:58.949765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:58.950446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:58.950914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:58.951336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:58.981255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-871f7b2a-f3b2-46fb-bec2-a1d9302fff82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044981 Sep 13 16:14:58.981798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 575/1149] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:14:58.995078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:58.997271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:59.003619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:59.004098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:59.004535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:59.005280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:59.005799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:59.006260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:59.019936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:14:59.037182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5f6bb618-52dc-4fca-a7f5-1cce0aa1e242 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Sep 13 16:14:59.037764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 575/1150] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:59.368433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:59.370592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:14:59.376423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:59.376895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:59.377325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:59.378005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:14:59.378447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:14:59.378865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:14:59.408603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6e1cd81-45f0-4895-b380-a6a1ec8139c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Sep 13 16:14:59.409142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 576/1151] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:14:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:14:59.994259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:14:59.996432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:00.002803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:00.003257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:00.003689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:00.004371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:00.004818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:00.005241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:00.034998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a1f642a9-ed63-456e-9e3f-db7123aee0b2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Sep 13 16:15:00.035538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 576/1152] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:14:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:00.049482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:00.051651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:00.057534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:00.057985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:00.058418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:00.059132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:00.059577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:00.059995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:00.092765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4b2385c-a8b3-4490-948a-2796b84244a5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047142 Sep 13 16:15:00.093315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 577/1153] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:00.421760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:00.423907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:00.430421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:00.430955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:00.431393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:00.432078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:00.432530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:00.432953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:00.462389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a04f764-9337-4d13-b5e5-e297169d120d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Sep 13 16:15:00.462954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 577/1154] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:01.047787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:01.049897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:01.056981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:01.057460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:01.057967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:01.058609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:01.059091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:01.059521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:01.063138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:01.089157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8bd32e6-b46c-449b-b846-da0680540ebd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045345 Sep 13 16:15:01.089713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 578/1155] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:01.106321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:01.108528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:01.114799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:01.115304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:01.115738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:01.116797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:01.117250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:01.117674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:01.146299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7be99dea-114a-41d8-869b-195da3cc09ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Sep 13 16:15:01.146858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 578/1156] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:01.474551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:01.476749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:01.482840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:01.483355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:01.483795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:01.484494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:01.484979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:01.485408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:01.514212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca844f95-dc9e-4a6f-a891-389ff8c5a890 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Sep 13 16:15:01.514757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 579/1157] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:02.102029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:02.104433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:02.110290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:02.110845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:02.111213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:02.111893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:02.112337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:02.112763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:02.142870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38912bc4-1b50-431d-8958-61d6ed6ef69a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045041 Sep 13 16:15:02.143373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 579/1158] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:02.159214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:02.161331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:02.168310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:02.168787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:02.169224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:02.169951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:02.170405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:02.170830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:02.199923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-957878e8-192d-44f7-bfb6-2d1c1acab86c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 13 16:15:02.200468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 580/1159] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:02.526303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:02.528353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:02.534251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:02.534716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:02.535170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:02.535845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:02.536288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:02.536705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:02.566158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85909f02-f405-4a43-b790-cfd7c94430cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Sep 13 16:15:02.566694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 580/1160] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:03.155425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:03.157447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:03.163762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:03.164327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:03.164652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:03.165333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:03.165780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:03.166202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:03.195557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee7e355c-1796-4dce-86f5-a1d9fbd34eda tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044214 Sep 13 16:15:03.196090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 581/1161] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:03.212698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:03.214832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:03.221082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:03.221548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:03.221980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:03.222651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:03.223122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:03.223539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:03.251854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-14fd0ce7-b277-48b0-9ebe-9a15203fe307 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Sep 13 16:15:03.252393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 581/1162] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:03.578814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:03.580955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:03.587025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:03.587505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:03.587943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:03.588626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:03.589078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:03.589508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:03.619089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83d4285e-2538-4112-9c38-feb5e9d308fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Sep 13 16:15:03.619636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 582/1163] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:04.208015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:04.210938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:04.216820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:04.217389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:04.217709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:04.218384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:04.218825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:04.219268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:04.248614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8068d6d-a165-40e8-b44a-5597f786d791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044445 Sep 13 16:15:04.249073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 582/1164] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:04.264504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:04.266616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:04.273524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:04.273999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:04.274433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:04.275145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:04.275599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:04.276026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:04.305474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5bcc6796-0f55-48c9-9121-64c252f4a7c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Sep 13 16:15:04.306020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 583/1165] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:04.631836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:04.634175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:04.640032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:04.640502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:04.640931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:04.641606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:04.642050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:04.642471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:04.671864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24014eca-617c-4297-93a5-97ca67ab8959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Sep 13 16:15:04.672412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 583/1166] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:05.260390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:05.262514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:05.268403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:05.268973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:05.269294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:05.269969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:05.270414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:05.270832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:05.299952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf01bb0f-ff18-481e-b156-99ba24a74acf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043654 Sep 13 16:15:05.300420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 584/1167] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:05.317538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:05.319784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:05.326060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:05.326534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:05.326992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:05.327668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:05.328112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:05.328529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:05.357427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e830ce87-9959-410d-be87-f16f729d1fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Sep 13 16:15:05.357974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 584/1168] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:05.684461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:05.686612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:05.692513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:05.692995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:05.693436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:05.694470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:05.695028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:05.695453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:05.724556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38d88a87-5b76-4cf9-b46b-a9848b785be1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Sep 13 16:15:05.725982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 585/1169] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:06.312777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:06.315024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:06.321772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:06.322342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:06.322665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:06.323425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:06.323874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:06.324324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:06.353767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0801dd91-28ff-4566-a82a-cdbedd0ba14b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044906 Sep 13 16:15:06.354313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 585/1170] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:06.370229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:06.372440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:06.378725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:06.379245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:06.379686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:06.380399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:06.381509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:06.382058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:06.410679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-209615ab-17c7-4c5d-93e3-e90fe5b6dbe7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Sep 13 16:15:06.411327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 586/1171] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:06.737863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:06.740008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:06.746501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:06.747010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:06.747443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:06.748123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:06.748575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:06.748992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:06.777445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5582e566-55e0-402c-bb7b-0081c9722611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Sep 13 16:15:06.777986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 586/1172] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:07.366470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:07.368606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:07.374757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:07.375413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:07.375691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:07.376380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:07.376840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:07.377289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:07.408007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee026037-47a6-4057-899b-3f3945b6c3aa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045537 Sep 13 16:15:07.408574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 587/1173] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:07.423309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:07.425524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:07.427892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:07.433486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:07.433964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:07.434392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:07.435180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:07.435622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:07.436039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:07.469235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2710f0e7-5bc7-4de7-a79c-044c9d065b4c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049886 Sep 13 16:15:07.469804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 587/1174] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:07.789693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:07.791886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:07.797697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:07.798177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:07.798613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:07.799327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:07.799784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:07.800211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:07.830120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e64ab37-338e-4533-8c53-0193e385b2cd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Sep 13 16:15:07.830683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 588/1175] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:08.420473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:08.422564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:08.429579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:08.430143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:08.430465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:08.431209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:08.431636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:08.432061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:08.482301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:08.484471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:08.492023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:08.492516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:08.492957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:08.493685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:08.494140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:08.494572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:08.528550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d536ed93-4b1c-4880-ba83-f67625045e4f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050304 Sep 13 16:15:08.529148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 589/1176] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:15:08.607179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2335b3e-e91c-424a-9227-4092898617b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190575 Sep 13 16:15:08.607716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 588/1177] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:08.842482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:08.844626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:08.850990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:08.851468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:08.852629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:08.852827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:08.853273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:08.853691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:08.884098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7e826c1-a11c-4156-8778-0727c46501d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Sep 13 16:15:08.884637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 590/1178] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:09.541425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:09.543507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:09.549354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:09.549845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:09.550270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:09.550979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:09.551433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:09.551859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:09.580089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f403d41f-529b-492a-ae70-b6cedb7477c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Sep 13 16:15:09.580623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 589/1179] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:09.618857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:09.621036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:09.627690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:09.628168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:09.628609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:09.629298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:09.629754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:09.630180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:09.659292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-318b2828-1861-4a0d-b0ee-f1e837df3e5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044494 Sep 13 16:15:09.659841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 591/1180] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:09.896890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:09.899100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:09.906111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:09.907068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:09.907846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:09.909076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:09.909892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:09.910668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:09.940548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2103c613-55a3-4661-9d66-e09d9a64f28e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Sep 13 16:15:09.941078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 590/1181] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:10.593005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:10.595109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:10.601937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:10.602417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:10.602848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:10.603566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:10.604014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:10.604440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:10.634205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35953e27-3876-48f4-aa12-f4737412b10a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Sep 13 16:15:10.634843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 592/1182] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:10.672322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:10.674408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:10.681365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:10.681838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:10.682268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:10.682971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:10.683419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:10.683836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:10.712064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f11ce2f-12ce-46b4-9267-7671e1a68300 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043617 Sep 13 16:15:10.712899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 591/1183] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:10.953222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:10.955356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:10.961924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:10.962402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:10.962838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:10.963545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:10.964026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:10.964449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:10.994098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b283edf3-2d25-4d8c-9ba4-f8abf6bfac83 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Sep 13 16:15:10.994645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 593/1184] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:11.648367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:11.650405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:11.656547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:11.657018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:11.657446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:11.658122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:11.658569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:11.659045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:11.661349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:11.691135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-617069cf-9c4b-4574-9631-56783260eb45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047468 Sep 13 16:15:11.692508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 592/1185] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:11.725381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:11.727854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:11.734024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:11.734493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:11.734945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:11.735638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:11.736082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:11.736505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:11.761822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:11.766946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-038a39a8-b1f8-45ce-9c20-d1dce93e0d50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046352 Sep 13 16:15:11.767508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 594/1186] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:12.006929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:12.009034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:12.014789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:12.015318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:12.015757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:12.016445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:12.016895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:12.017320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:12.047275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-23d997bd-5343-4d52-ade4-197eaf71273e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Sep 13 16:15:12.047831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 593/1187] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:12.703143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:12.705308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:12.711259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:12.711746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:12.712186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:12.712877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:12.713334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:12.713764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:12.744440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e01741fd-ee31-4e9b-870e-b36d972bf90c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Sep 13 16:15:12.745055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 595/1188] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:12.779906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:12.782037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:12.789081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:12.789555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:12.789988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:12.790668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:12.791147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:12.791573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:12.821767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18095bec-82ab-4500-844e-e7dc66f396a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045842 Sep 13 16:15:12.822309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 594/1189] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:13.059751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:13.061846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:13.067866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:13.068354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:13.068790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:13.069486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:13.069943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:13.070379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:13.100204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f505ce14-a7da-4fcc-8898-f13ace6432e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Sep 13 16:15:13.100766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 596/1190] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:13.756260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:13.758373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:13.764256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:13.764666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:13.765095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:13.765772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:13.766214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:13.766628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:13.796121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d598aeb4-2b89-4068-850e-835f9f7d9c7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Sep 13 16:15:13.796729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 595/1191] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:13.833901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:13.836130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:13.842461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:13.842970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:13.843392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:13.844078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:13.844523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:13.844943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:13.874185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec9feca8-829c-42a2-90d9-8b2878ef50f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044547 Sep 13 16:15:13.874726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 597/1192] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:15:14.112613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:14.115690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:14.121526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:14.122003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:14.122438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:14.123142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:14.123594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:14.124015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:14.152948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-04dc916c-e338-4f04-a328-ed40336e1b35 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Sep 13 16:15:14.153484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 596/1193] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:14.808401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:14.810527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:14.816422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:14.816897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:14.817327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:14.818334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:14.818794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:14.819247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:14.849393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0aa4f90-e91a-49c1-9a86-b690825b7fce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Sep 13 16:15:14.850275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 598/1194] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:14.886705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:14.888851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:14.895147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:14.896154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:14.896578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:14.897358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:14.897802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:14.898219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:14.927298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57244d76-25c3-4652-a4cd-cee6d8e85796 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044282 Sep 13 16:15:14.927978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 597/1195] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:15.165340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:15.167434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:15.173226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:15.173705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:15.174136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:15.174810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:15.175287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:15.175711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:15.204911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-520d49e3-356a-4323-b9f4-89c98dc5a573 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Sep 13 16:15:15.205456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 599/1196] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:15.862333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:15.865203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:15.871150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:15.871630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:15.872065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:15.872744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:15.873193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:15.873616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:15.902990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-39a526ef-ef57-4f70-b0d1-142bab9ae7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Sep 13 16:15:15.903599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 598/1197] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:15.939783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:15.941918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:15.949112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:15.949600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:15.950131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:15.950833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:15.951338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:15.951772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:15.981816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-893d0f10-9057-417f-9fcb-365e08b687c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046011 Sep 13 16:15:15.982371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 600/1198] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:16.217967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:16.220032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:16.226729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:16.227225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:16.227659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:16.228339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:16.228790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:16.229213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:16.257437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0623ac94-4512-4f6e-931c-36b062df03a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043438 Sep 13 16:15:16.257971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 599/1199] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:16.915972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:16.918085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:16.923977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:16.924449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:16.924878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:16.925557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:16.925999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:16.926417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:16.956634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc5f092a-c5f6-4667-bbbf-70f9f47cba79 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Sep 13 16:15:16.957224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 601/1200] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:16.994678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:16.996844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:17.003325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:17.003805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:17.004241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:17.005505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:17.006102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:17.006528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:17.034353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b33e28f4-bad5-4468-bf2b-520939ea2f87 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043580 Sep 13 16:15:17.034890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 600/1201] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:17.269750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:17.272246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:17.278451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:17.278967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:17.279411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:17.280106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:17.280562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:17.280994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:17.310969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a17d1f7e-3842-4d07-94fb-3f57a7dbc3d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Sep 13 16:15:17.311515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 602/1202] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:17.968860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:17.971018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:17.977323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:17.977798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:17.978230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:17.978933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:17.979382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:17.979803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:18.009187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c751eaed-8f43-49e4-af32-6b5e942d09c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Sep 13 16:15:18.009779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 601/1203] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:18.046197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:18.048348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:18.054927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:18.055414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:18.055848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:18.056536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:18.056992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:18.057424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:18.087209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-edcbab71-a9c8-4b48-8414-69f2b65a57ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044900 Sep 13 16:15:18.087768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 603/1204] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:18.324229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:18.326370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:18.332165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:18.332693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:18.333139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:18.333913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:18.334359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:18.334779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:18.363055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51a322b3-f2d7-4e81-95c7-3cad900bbfb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Sep 13 16:15:18.363588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 602/1205] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:19.021764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:19.023815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:19.029661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:19.030137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:19.030561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:19.031267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:19.031710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:19.032127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:19.064364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfc86e47-eb55-4302-b2b4-7dcc214e3cc6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Sep 13 16:15:19.064941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 604/1206] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:19.099804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:19.102761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:19.109150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:19.109623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:19.110056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:19.110741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:19.111213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:19.111635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:19.140022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18b9b29f-acbc-41c6-a0fb-ca92010511ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044471 Sep 13 16:15:19.140558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 603/1207] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:19.382324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:19.384458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:19.390276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:19.390753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:19.391219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:19.391902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:19.392349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:19.392768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:19.422701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6831f8c4-102f-4d77-a983-9cf87cb18703 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Sep 13 16:15:19.423275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 605/1208] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:20.076792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:20.078962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:20.085429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:20.085918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:20.086355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:20.087076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:20.087527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:20.087951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:20.119742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-63a4eb23-6936-4546-809f-8cf3ee7f141c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Sep 13 16:15:20.120388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 604/1209] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:20.152743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:20.154940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:20.161840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:20.162314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:20.162748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:20.163461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:20.163911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:20.164337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:20.193073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11fb5ba9-df9c-4e61-b9e1-ecb3217c22b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044317 Sep 13 16:15:20.193617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 606/1210] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:20.436545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:20.438580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:20.444936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:20.445413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:20.445845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:20.446526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:20.447006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:20.447432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:20.477209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-617c7f00-1cbd-4eb9-8a88-3d074208566a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Sep 13 16:15:20.477760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 605/1211] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:21.132468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:21.134617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:21.140552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:21.141023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:21.141453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:21.142134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:21.142578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:21.143034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:21.172551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5dc8650e-7bad-44b2-a362-31de5fa7c706 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Sep 13 16:15:21.173134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 607/1212] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:21.204667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:21.206805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:21.213168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:21.213642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:21.214087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:21.214773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:21.215418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:21.215844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:21.246084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb0df8d3-216e-4f8d-8342-6c6268d3039b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045345 Sep 13 16:15:21.246627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 606/1213] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:21.489810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:21.491952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:21.497844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:21.498331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:21.498772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:21.499496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:21.499953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:21.500386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:21.529617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07f5a2d4-206a-4a3c-bc97-a536ee83169d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Sep 13 16:15:21.530167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 608/1214] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:22.185996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:22.188167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:22.194667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:22.195181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:22.195626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:22.196315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:22.196768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:22.197196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:22.226248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81a684fc-54c2-457a-990b-261d920fb4b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Sep 13 16:15:22.226855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 607/1215] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:22.259671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:22.261785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:22.268098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:22.268571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:22.269003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:22.269688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:22.270134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:22.270558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:22.298980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dcb72606-8dd2-4ae4-9b4a-b84e1b9b6010 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043219 Sep 13 16:15:22.299537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 609/1216] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:22.542577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:22.544658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:22.551014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:22.552037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:22.552470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:22.553154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:22.553603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:22.554026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:22.578137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:22.583242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ddd4991f-ab84-41ac-a5db-fbc644a0c0a5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Sep 13 16:15:22.583789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 608/1217] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:23.238613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:23.240688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:23.242584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:23.247697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:23.248177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:23.248613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:23.249305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:23.249756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:23.250183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:23.280384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e222661f-143f-44b8-9cce-ff4b203af06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Sep 13 16:15:23.281009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 610/1218] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:23.311996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:23.314173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:23.321228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:23.321700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:23.322128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:23.322800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:23.323270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:23.323691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:23.353012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2e8f7f6-419a-4970-8643-cccdf69b8d79 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044953 Sep 13 16:15:23.353552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 609/1219] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:15:23.595706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:23.597863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:23.604035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:23.604507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:23.604938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:23.605611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:23.606057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:23.606479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:23.622833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:23.636796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08d8df7e-9799-491f-a47b-229914fe20ac tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Sep 13 16:15:23.637337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 611/1220] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:24.292838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:24.295200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:24.302055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:24.302536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:24.303005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:24.303702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:24.304157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:24.304581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:24.333909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9a91078-25c0-407b-b34a-bfcad742863e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044963 Sep 13 16:15:24.334557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 610/1221] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:24.365448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:24.367605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:24.373895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:24.374371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:24.374824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:24.375515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:24.376015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:24.376444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:24.407029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-689d1650-45eb-4f44-82d3-dca65c1b3a1f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045512 Sep 13 16:15:24.407584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 612/1222] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:24.650203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:24.652305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:24.658123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:24.658595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:24.659069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:24.659747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:24.660802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:24.661225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:24.689472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-914df745-3737-4581-8c80-702768a809c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Sep 13 16:15:24.690005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 611/1223] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:25.346244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:25.348495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:25.354741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:25.355265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:25.355707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:25.356398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:25.356853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:25.357279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:25.387382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59604449-a033-4c70-982f-572d3f12e79a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Sep 13 16:15:25.388050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 613/1224] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:25.419148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:25.421295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:25.423291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:15:25.423432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:15:25.431010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:25.431514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:25.432053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:25.432745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:25.433196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:25.433622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:25.463939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bf4e202-e3fe-42ec-95da-d85103b93c93 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048720 Sep 13 16:15:25.464512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 612/1225] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:25.702057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:25.704147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:25.710104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:25.710562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:25.711022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:25.711717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:25.712172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:25.712809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:25.743299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bde772d-0faf-4074-bf2b-e6356047c3b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Sep 13 16:15:25.743849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 614/1226] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:26.399237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:26.401402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:26.407287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:26.407758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:26.408195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:26.408884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:26.409309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:26.409729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:26.439224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a21649c6-886c-4d03-bbba-1d0fd1a0acd0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Sep 13 16:15:26.439867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 613/1227] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:26.477207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:26.479471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:26.485739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:26.486223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:26.486658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:26.487380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:26.487832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:26.488854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:26.517185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-130d3f3a-ea46-491b-9963-a2b21801c22f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044697 Sep 13 16:15:26.517736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 615/1228] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:26.755168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:26.757269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:26.763183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:26.763664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:26.764095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:26.764774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:26.765218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:26.765636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:26.794993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-351259e8-ce80-4843-b9c0-685d2e000dce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043800 Sep 13 16:15:26.795529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 614/1229] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:27.451984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:27.454145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:27.460634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:27.461114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:27.461550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:27.462237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:27.462695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:27.463150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:27.493004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-984c9916-0261-4f8c-9310-f38e0cebb6fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Sep 13 16:15:27.493617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 616/1230] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:27.528738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:27.530918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:27.537960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:27.538436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:27.538866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:27.539575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:27.540022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:27.540449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:27.568725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-015d60b6-a451-4a23-b1d9-ecba2b69ef53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043790 Sep 13 16:15:27.569206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 615/1231] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:27.807250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:27.809371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:27.815286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:27.815763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:27.816808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:27.817581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:27.818037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:27.818461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:27.847434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad5278ad-f4a9-40d9-bb49-f083713709cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Sep 13 16:15:27.847973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 617/1232] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:15:28.506101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:28.508288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:28.514253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:28.514733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:28.515198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:28.515892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:28.516342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:28.516767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:28.546304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4e41bfb-5f0c-4527-8d8e-83a05fa396b2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Sep 13 16:15:28.546938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 616/1233] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:28.581227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:28.583618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:28.589988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:28.590469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:28.590925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:28.591606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:28.592054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:28.592476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:28.623148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2da57b92-ae7d-4b41-ac58-c5f7796d004f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045856 Sep 13 16:15:28.623694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 618/1234] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:28.860503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:28.862312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:28.868260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:28.868743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:28.869209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:28.869903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:28.870354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:28.870781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:28.901319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76456a29-c1ad-44ae-9588-955774632a50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Sep 13 16:15:28.901874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 617/1235] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:29.559386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:29.561547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:29.568925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:29.569413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:29.569853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:29.570546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:29.571030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:29.571459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:29.601131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a451be0-d331-4c60-ace7-8dc85217bd27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 13 16:15:29.601743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 619/1236] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:29.635962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:29.638065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:29.644674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:29.645221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:29.645653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:29.646328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:29.646799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:29.647241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:29.675998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-60595fd3-b939-44e4-bf8f-1d9cc2c0f9b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043614 Sep 13 16:15:29.676757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 618/1237] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:29.913856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:29.915971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:29.921826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:29.922305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:29.922741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:29.923449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:29.923901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:29.924325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:29.953479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19f98ebc-ad41-4853-9052-0ccb6ecd1b49 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Sep 13 16:15:29.954018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 620/1238] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:30.613803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:30.615987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:30.621841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:30.622312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:30.622741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:30.623439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:30.623884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:30.624299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:30.653421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8f07156-7d6d-4a53-8385-9c248f0ada34 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Sep 13 16:15:30.654023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 619/1239] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:30.688711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:30.691690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:30.698173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:30.698617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:30.699206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:30.699900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:30.700352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:30.700773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:30.733210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d944f86e-de23-461b-bdc7-bfa663175386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048400 Sep 13 16:15:30.733763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 621/1240] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:30.965713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:30.967851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:30.973858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:30.974342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:30.974783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:30.975769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:30.976228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:30.976660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:31.005574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d232ff12-9755-4ed9-8964-5186cc3971b3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Sep 13 16:15:31.006124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 620/1241] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:31.666323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:31.668460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:31.674349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:31.674824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:31.675863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:31.676611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:31.677065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:31.677486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:31.706213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb2846e7-11dd-4fcd-8d0f-6046a5a3b5a3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Sep 13 16:15:31.707327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 622/1242] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:31.745629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:31.747824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:31.749776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:15:31.749918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:15:31.756677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:31.757149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:31.757579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:31.758263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:31.758708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:31.759158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:31.789514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9064cd79-5e35-4e34-87ff-9ecec685bd14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047856 Sep 13 16:15:31.790064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 621/1243] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:32.017695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:32.020355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:32.026152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:32.026632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:32.027142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:32.027833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:32.028285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:32.028716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:32.058492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1752d00e-3749-409a-8853-8b93ef0bd9a4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Sep 13 16:15:32.059077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 623/1244] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:32.719000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:32.721121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:32.727731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:32.728205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:32.728630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:32.729335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:32.729781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:32.730200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:32.762090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-344f9e9e-1049-4820-9072-f9ed00ddea2a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 Sep 13 16:15:32.766582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 622/1245] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:32.802121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:32.804258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:32.810577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:32.811036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:32.811472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:32.813183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:32.813634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:32.814058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:32.843335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7be3d5b3-09b0-405a-bde8-e3ddcbf3b4cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045633 Sep 13 16:15:32.843896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 624/1246] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:33.070832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:33.072978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:33.078812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:33.079320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:33.079750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:33.080427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:33.080874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:33.081423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:33.110345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9fc4de0e-fe93-4ab6-a2df-c767f0106316 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Sep 13 16:15:33.110880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 623/1247] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:33.778828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:33.780975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:33.786886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:33.787396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:33.787832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:33.788517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:33.789051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:33.789495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:33.818545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04b3e5f7-9c27-4c3d-acbf-27abcbb8af64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Sep 13 16:15:33.819181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 625/1248] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:33.855544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:33.857706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:33.864259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:33.864737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:33.865169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:33.865844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:33.866287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:33.866704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:33.896068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56e20f40-b7d4-4c1f-af68-44d87d106d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044360 Sep 13 16:15:33.896549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 624/1249] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:34.123252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:34.125390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:34.131878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:34.132352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:34.132785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:34.133458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:34.133909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:34.134329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:34.162700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dffcb626-f19c-491c-aaf0-25d3144b26f5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Sep 13 16:15:34.163199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 626/1250] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:34.831661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:34.834213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:34.840606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:34.841083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:34.841516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:34.842203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:34.842647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:34.843101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:34.857541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:34.874609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf685fc0-b671-4625-83ef-207410194a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047676 Sep 13 16:15:34.875228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 625/1251] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:34.908300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:34.911217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:34.917558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:34.918032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:34.918464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:34.919170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:34.919617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:34.920039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:34.949351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9587429d-c094-4869-a923-a12d3ecd9f77 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044914 Sep 13 16:15:34.949822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 627/1252] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:35.175326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:35.177544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:35.183415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:35.183894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:35.184347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:35.185013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:35.185462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:35.185885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:35.215817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-264d45bd-9a8c-41c5-ba72-b04243e2600e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Sep 13 16:15:35.216290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 626/1253] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:35.887399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:35.889417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:35.896069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:35.896541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:35.896972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:35.897651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:35.898101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:35.898518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:35.902007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:35.928969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-524c2642-c891-4146-a2b6-874e73d4f101 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Sep 13 16:15:35.929563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 628/1254] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:35.962363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:35.964515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:35.970925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:35.971429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:35.971941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:35.972631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:35.973084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:35.973508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:36.005032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35501be8-5dbe-4a1c-a495-9cf81e062d76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046527 Sep 13 16:15:36.005632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 627/1255] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:36.228470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:36.230530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:36.236376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:36.236846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:36.237281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:36.237960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:36.238402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:36.238847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:36.267084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-73f54174-c7bd-4a33-b847-27226d47401b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Sep 13 16:15:36.267625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 629/1256] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:36.941563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:36.943708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:36.949593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:36.950074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:36.950506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:36.951222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:36.951670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:36.952093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:36.981331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf0f5e54-73c3-46ca-9052-76466f05bedb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Sep 13 16:15:36.981931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 628/1257] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:37.017396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:37.019577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:37.025908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:37.026386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:37.026817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:37.027555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:37.028007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:37.028432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:37.058464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-697afd24-67da-4c4e-b99a-9855b312de37 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044913 Sep 13 16:15:37.058970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 630/1258] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:37.280167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:37.282299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:37.289297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:37.289772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:37.290205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:37.290890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:37.291362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:37.291784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:37.320038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5ebf19c-d001-4164-bf9e-4e6629149b6f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Sep 13 16:15:37.320539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 629/1259] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:37.994661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:37.996917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:37.999193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:15:37.999331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:15:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:15:38.006327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:38.006809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:38.007274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:38.007969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:38.008418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:38.008841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:38.039802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f23404d3-290e-4dd1-aae1-d7fa5377187e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049757 Sep 13 16:15:38.040444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 631/1260] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:38.071733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:38.073847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:38.076179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:38.081521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:38.081992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:38.082423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:38.083129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:38.083575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:38.083992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:38.113048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cdac4ecf-37ec-4747-a3ad-b41e7f0805a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045136 Sep 13 16:15:38.113516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 630/1261] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:38.332607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:38.334788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:38.340597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:38.341072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:38.341500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:38.342178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:38.342624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:38.343078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:38.372492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1708267-d50d-469d-b226-a62298a0ae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Sep 13 16:15:38.372967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 632/1262] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:39.052588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:39.054735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:39.060897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:39.061385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:39.061851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:39.062610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:39.063104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:39.064054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:39.093780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bbcb0dff-ac8a-4dfd-856d-5c7a629d5cc9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045458 Sep 13 16:15:39.094390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 631/1263] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:15:39.125373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:39.127988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:39.134389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:39.134865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:39.135333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:39.136019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:39.136470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:39.136894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:39.165935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a75dce0-36be-49e9-83e3-5353c2a8bc45 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044566 Sep 13 16:15:39.166475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 633/1264] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:39.385169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:39.387257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:39.393228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:39.393707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:39.394148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:39.394855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:39.395339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:39.395766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:39.424809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93e89489-6c42-481b-9d73-b8ca80303ef5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Sep 13 16:15:39.425452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 632/1265] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:40.106034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:40.108181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:40.114702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:40.115203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:40.115640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:40.116316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:40.116760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:40.117181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:40.146831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19d77bbb-7ccb-48f8-9817-95681ee37189 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Sep 13 16:15:40.147443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 634/1266] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:40.178079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:40.180326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:40.186262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:40.186731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:40.187202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:40.187878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:40.188322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:40.188741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:40.217362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e5c62a0-9bf2-470a-a2aa-21c403ce4145 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043727 Sep 13 16:15:40.217897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 633/1267] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:40.437321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:40.439495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:40.445352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:40.445823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:40.446253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:40.446959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:40.447403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:40.447821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:40.478049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2ed56b6-cc62-4eb4-87f2-cb7aed216268 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Sep 13 16:15:40.478603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 635/1268] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:41.158602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:41.160914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:41.167270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:41.167745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:41.168176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:41.168851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:41.169310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:41.169717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:41.198341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ddde08f8-e4fb-4f57-a1d8-1b10876730b8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Sep 13 16:15:41.198972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 634/1269] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:41.230976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:41.233085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:41.239823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:41.240297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:41.240730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:41.241408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:41.241851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:41.242269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:41.272037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17daef33-6970-44bf-a59f-de111948e076 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045056 Sep 13 16:15:41.272576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 636/1270] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:41.490728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:41.492941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:41.498804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:41.499317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:41.499758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:41.500445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:41.500896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:41.501319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:41.530201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-adad714a-6f52-4d0a-b7e7-1c90ecb217e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Sep 13 16:15:41.530736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 635/1271] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:42.210920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:42.213215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:42.219569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:42.220043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:42.220471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:42.221157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:42.221601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:42.222539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:42.255553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75735d6e-2c3c-4dfb-9836-aacd9c85e4fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048436 Sep 13 16:15:42.256418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 637/1272] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:42.285338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:42.287736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:42.294162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:42.294644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:42.295149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:42.295854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:42.296496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:42.296925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:42.328670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-89687cca-4772-46b0-b4a0-0938ce6b1c2c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047909 Sep 13 16:15:42.329247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 636/1273] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:42.542760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:42.544985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:42.551834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:42.552308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:42.552740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:42.553427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:42.553883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:42.554402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:42.588202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fde760e0-72fc-446f-a0e0-9f74b69fa9d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049290 Sep 13 16:15:42.588664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 638/1274] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:43.267152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:43.269876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:43.275783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:43.276287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:43.276720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:43.277410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:43.277893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:43.278319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:43.307734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8c13d3b-a0ed-468a-9816-370454c2d72f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Sep 13 16:15:43.308388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 637/1275] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:43.341689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:43.343839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:43.351265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:43.351744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:43.352179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:43.352868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:43.353311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:43.353731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:43.382981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27d7d5af-867c-4954-b824-4cb0c1bbee16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Sep 13 16:15:43.383518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 639/1276] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:43.600947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:43.603132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:43.608981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:43.609458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:43.609893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:43.610575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:43.611052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:43.611476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:43.640424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb5437b6-3988-421a-8b8d-aeca6bde5c23 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Sep 13 16:15:43.640964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 638/1277] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:44.320974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:44.323067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:44.329182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:44.329656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:44.330086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:44.330763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:44.331269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:44.332187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:44.361602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-453df226-9139-4fa1-940f-3d5a688ed698 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Sep 13 16:15:44.362214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 640/1278] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:44.396147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:44.398253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:44.404581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:44.405053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:44.405481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:44.406157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:44.406604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:44.407049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:44.436731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-643174b1-a0cc-4bfb-8e38-c66f2ee6f8f6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044883 Sep 13 16:15:44.437270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 639/1279] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:44.653493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:44.655665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:44.662604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:44.663101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:44.663532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:44.664209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:44.664660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:44.665081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:44.694363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-962e5119-6dce-4876-a093-ba38f679810b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Sep 13 16:15:44.694933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 641/1280] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:45.374784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:45.376950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:45.383474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:45.383947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:45.384375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:45.385045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:45.385487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:45.385904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:45.414584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65fa75fc-45f8-4e36-9ab0-b27468f427da tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Sep 13 16:15:45.415275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 640/1281] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:45.449264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:45.451456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:45.457983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:45.458461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:45.458889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:45.459619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:45.460062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:45.460480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:45.491265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a814091c-73a7-44df-90df-89b0f8347e38 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045850 Sep 13 16:15:45.491813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 642/1282] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:45.706556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:45.708624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:45.714496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:45.715044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:45.715480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:45.716163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:45.716604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:45.717019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:45.746312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d061b38-693e-4542-9034-db9796aa570b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043707 Sep 13 16:15:45.746844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 641/1283] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:46.427034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:46.429401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:46.436978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:46.437457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:46.437886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:46.438572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:46.439052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:46.439555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:46.469801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1673d065-1b92-400d-ac5f-8e48d5a3860e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Sep 13 16:15:46.470423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 643/1284] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:46.504313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:46.506473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:46.512822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:46.513300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:46.513735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:46.514413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:46.514869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:46.515317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:46.519586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:46.544456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bcfab2c3-a011-470b-a61b-9e75e206d55e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044734 Sep 13 16:15:46.545001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 642/1285] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:46.759396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:46.761472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:46.767351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:46.767837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:46.768276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:46.769170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:46.769685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:46.770126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:46.794303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:46.800216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd295569-0e7a-4013-95e4-e6c2c7ee7a0f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Sep 13 16:15:46.800877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 644/1286] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:47.482590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:47.484767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:47.491768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:47.492245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:47.492674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:47.493346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:47.493787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:47.494204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:47.522864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a298e92b-80d1-4834-a09e-54c046e7c5b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Sep 13 16:15:47.523481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 643/1287] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:15:47.556999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:47.559162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:47.565428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:47.566170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:47.566609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:47.567321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:47.567771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:47.568191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:47.597615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62a09efc-9235-40d8-9028-d32cb1cb1378 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043982 Sep 13 16:15:47.598167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 645/1288] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:47.812426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:47.814485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:47.820732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:47.821216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:47.821653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:47.822333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:47.822784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:47.823237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:47.853683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-42613dec-e4cb-4dd4-8e7c-f456e5cf3402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Sep 13 16:15:47.854225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 644/1289] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:48.535927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:48.538041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:48.544369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:48.544847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:48.545282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:48.545965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:48.546414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:48.546839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:48.575049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-561492e3-85c0-46c5-9220-e454e4d4d60e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Sep 13 16:15:48.575628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 646/1290] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:48.610184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:48.612385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:48.618835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:48.619348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:48.619783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:48.620471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:48.620919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:48.621343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:48.654108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9d8f8d5-1265-4467-9b63-e7b58e23f04f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047799 Sep 13 16:15:48.654676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 645/1291] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:48.866092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:48.868256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:48.874103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:48.874575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:48.875061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:48.875745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:48.876189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:48.876611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:48.906789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d03aed7-d336-41de-9f41-cd6c620f25e7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Sep 13 16:15:48.907443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 647/1292] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:49.587151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:49.589279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:49.595182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:49.595661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:49.596095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:49.597517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:49.597979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:49.598407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:49.627870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5bbe347-9f50-4459-b2a5-9de22accc182 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044572 Sep 13 16:15:49.628493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 646/1293] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:49.666555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:49.668716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:49.675820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:49.676333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:49.676777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:49.677468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:49.677942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:49.678354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:49.706884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ccb4523-71b8-4b95-b6b0-ab454c4bd1c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Sep 13 16:15:49.707527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 648/1294] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:49.918819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:49.920978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:49.927279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:49.927756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:49.928187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:49.928867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:49.929313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:49.929736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:49.959308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-113ea41f-d349-4717-b1d9-bc1472ab73bc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Sep 13 16:15:49.959852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 647/1295] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:50.640162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:50.642298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:50.648757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:50.649231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:50.649666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:50.650348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:50.650800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:50.651245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:50.680543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab0f0d49-d434-4805-ae08-74016fd7d754 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Sep 13 16:15:50.681149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 649/1296] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:50.719202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:50.721479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:50.728284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:50.728758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:50.729193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:50.729878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:50.730323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:50.730747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:50.760466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e958c84a-003a-47e4-a054-3bd0b80d66a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045224 Sep 13 16:15:50.761012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 648/1297] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:50.972097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:50.974515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:50.980349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:50.980824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:50.981273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:50.981927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:50.982379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:50.982797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:51.011834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06bcf3c3-85e9-41ed-afd5-d38d057f31bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Sep 13 16:15:51.012375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 650/1298] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:51.693435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:51.695657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:51.701681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:51.702159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:51.702597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:51.703335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:51.703788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:51.704218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:51.734172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e75bf6a-85e6-4af7-a058-15082f065a18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Sep 13 16:15:51.734831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 649/1299] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:51.773780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:51.775931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:51.782158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:51.782631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:51.783106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:51.783833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:51.784586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:51.785021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:51.813838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75c59daa-c536-40bd-baf2-4f3f536ef20f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044124 Sep 13 16:15:51.814486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 651/1300] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:52.025374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:52.027554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:52.034102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:52.034579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:52.035044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:52.035733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:52.036181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:52.036601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:52.069205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24e829d7-6746-49b4-bd93-0a5d66458d8b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Sep 13 16:15:52.069765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 650/1301] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:52.745519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:52.747760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:52.753813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:52.754287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:52.754718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:52.755418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:52.755866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:52.756314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:52.785521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-208f976a-f240-42cf-9236-56e5f58879f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Sep 13 16:15:52.786141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 652/1302] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:52.827165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:52.829294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:52.835776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:52.836258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:52.836697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:52.837388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:52.838146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:52.838586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:52.869338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1499eb6f-81d3-4a47-95a7-d33baa374b3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046126 Sep 13 16:15:52.869893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 651/1303] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:53.081488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:53.083629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:53.089470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:53.089943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:53.090375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:53.091099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:53.091547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:53.091968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:53.121242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60f15f69-0b86-4a7a-bd9a-8c1982ed2ac1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Sep 13 16:15:53.121772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 653/1304] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:53.797881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:53.800099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:53.806020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:53.806499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:53.806961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:53.807655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:53.808107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:53.808528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:53.837696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d83dbb50-814d-4b14-86a1-58195d28c432 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Sep 13 16:15:53.838346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 652/1305] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:53.882508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:53.884624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:53.886926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:53.892082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:53.892554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:53.893017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:53.894655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:53.895136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:53.895564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:53.924601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55e50d0c-0635-4d46-84c2-d5cebca92ecd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046891 Sep 13 16:15:53.925143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 654/1306] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:54.134417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:54.136710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:54.142583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:54.143836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:54.144599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:54.145286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:54.145741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:54.146166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:54.174891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a1b529b1-def2-4655-a3aa-0ca47fed38cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Sep 13 16:15:54.175464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 653/1307] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:54.850744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:54.852908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:54.858859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:54.859447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:54.859899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:54.860598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:54.861049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:54.861476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:54.891618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a90c36ed-77ff-4b62-9f59-2f93462c84f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Sep 13 16:15:54.892169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 655/1308] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:54.937355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:54.939677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:54.946245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:54.946731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:54.947205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:54.947918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:54.948370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:54.948797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:54.978053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a60be24-5f3f-4204-98d0-78fdf948fe24 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044770 Sep 13 16:15:54.978599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 654/1309] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:55.186374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:55.188620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:55.194620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:55.195149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:55.195592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:55.196293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:55.196749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:55.197182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:55.226958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61c353e6-e690-46c2-a018-846c2356ac5e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044572 Sep 13 16:15:55.227510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 656/1310] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:55.904081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:55.906212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:55.916248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:55.916248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:55.916248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:55.916248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:55.916606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:55.916606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:55.945122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab61ef06-38f4-487d-8095-865539110997 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Sep 13 16:15:55.945737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 655/1311] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:55.990079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:55.992273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:55.998577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:55.999091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:55.999525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:56.000204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:56.000652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:56.001074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:56.030054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15f1f53d-df2d-4728-83e2-14e4a2d95711 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044406 Sep 13 16:15:56.030602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 657/1312] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:56.239343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:56.241415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:56.247279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:56.247756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:56.248192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:56.248874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:56.249325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:56.249776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:56.279266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07607978-10f0-4d83-9cac-c974e6fe8fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Sep 13 16:15:56.279809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 656/1313] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:56.958370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:56.960611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:56.967008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:56.967557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:56.967925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:56.968629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:56.969085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:56.969514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:56.999972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57631bbb-be11-495f-be6d-b197842b1133 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046354 Sep 13 16:15:57.000599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 658/1314] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:57.042643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:57.044942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:57.052070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:57.052551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:57.052993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:57.053688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:57.054141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:57.054568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:57.084412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac7df16b-71a4-47a8-bde3-ddc23221c26d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045567 Sep 13 16:15:57.084969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 657/1315] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:57.291890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:57.293972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:57.300477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:57.300958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:57.301395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:57.302082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:57.302536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:57.302984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:57.332387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4f48048b-7899-4284-856e-f999384d4704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Sep 13 16:15:57.332939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 659/1316] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:58.013583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:58.016834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:58.023354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:58.023987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:58.024453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:58.025279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:58.025735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:58.026163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:58.052825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:58.058213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21b7c14a-1ab8-40f3-84fe-f7c717713d9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048662 Sep 13 16:15:58.058772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 658/1317] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:58.097412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:58.099838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:58.106198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:58.106682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:58.107160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:58.107882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:58.108337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:58.108765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:58.137260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2635ccd8-af2a-46f5-8030-27af31242512 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044527 Sep 13 16:15:58.137807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 660/1318] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:58.345213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:58.347401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:58.353667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:58.354147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:58.354581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:58.355283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:58.355735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:58.356159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:58.385372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c2b6641-5d15-4e81-9a6f-2121e4b6b225 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Sep 13 16:15:58.385915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 659/1319] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:59.078698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:59.080856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:59.087018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:59.087501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:59.087940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:59.088633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:59.089085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:59.089520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:59.106203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:15:59.120514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52139f43-ac12-4160-8bcf-1dcfe820baa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045642 Sep 13 16:15:59.121063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 661/1320] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:15:59.154851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:59.156935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:59.164243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:59.164726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:59.165168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:59.165860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:59.166315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:59.166801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:59.196356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1fe6e1c5-0f93-493c-8b98-4a4c621ecb50 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Sep 13 16:15:59.196907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 660/1321] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:15:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:15:59.397679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:15:59.399946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:15:59.405865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:59.406301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:59.406738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:59.407454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:15:59.407910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:15:59.408906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:15:59.437957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-648d09a7-8505-4db6-8d52-dd5e9910b3b9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Sep 13 16:15:59.438503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 662/1322] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:15:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:00.133501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:00.135786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:00.141584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:00.142057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:00.143364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:00.144417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:00.144869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:00.145293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:00.174340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0496f41e-25bd-4f2e-9fd6-f4c1bc64aff0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Sep 13 16:16:00.174983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 661/1323] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:00.208783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:00.210944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:00.217414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:00.217888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:00.218320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:00.219030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:00.219479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:00.219899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:00.248594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-376bbd3a-6fe9-4a5d-968c-9d7b8ebc402e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044425 Sep 13 16:16:00.249129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 663/1324] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:00.450428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:00.452590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:00.459014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:00.459495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:00.459946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:00.460615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:00.461065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:00.461485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:00.490500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa659aba-d81c-4af9-8491-63f093ac0a8e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Sep 13 16:16:00.491144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 662/1325] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:01.186492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:01.188936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:01.195696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:01.196183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:01.196622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:01.197317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:01.197774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:01.198202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:01.227543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41b970e4-034c-4169-947e-73acfe3cf7cb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Sep 13 16:16:01.228174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 664/1326] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:01.261701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:01.263944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:01.270913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:01.271400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:01.271835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:01.272518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:01.272965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:01.273387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:01.303293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f5763dc-8d6c-46c9-9f59-346f10f41518 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045449 Sep 13 16:16:01.303849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 663/1327] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:01.503797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:01.505838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:01.511713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:01.512194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:01.512630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:01.513315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:01.513768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:01.514194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:01.543183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af38453c-0bd1-47ad-96ab-69ab0e24f010 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Sep 13 16:16:01.543727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 665/1328] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:02.240256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:02.242402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:02.248551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:02.249031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:02.249603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:02.250300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:02.250750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:02.251211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:02.281538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d540b58-02d4-494e-9b70-007d1b24f7e2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045610 Sep 13 16:16:02.282184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 664/1329] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:02.316654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:02.318705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:02.325011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:02.325479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:02.325907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:02.326585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:02.327059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:02.327478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:02.357915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0d65ae9-b438-40cc-af5f-3453f40d09b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046061 Sep 13 16:16:02.358452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 666/1330] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:02.555781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:02.557966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:02.563861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:02.565047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:02.565484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:02.566168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:02.566617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:02.567139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:02.595061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64ef0e46-1228-4214-8c7f-edf70d083321 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Sep 13 16:16:02.595645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 665/1331] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:03.294793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:03.296984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:03.303609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:03.304008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:03.304446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:03.305145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:03.305606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:03.306035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:03.335692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-620a284a-5b79-4a6f-8f9f-fee83ce3f971 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044881 Sep 13 16:16:03.336295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 667/1332] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:03.371132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:03.373472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:03.380754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:03.381233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:03.381676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:03.382366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:03.382816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:03.383270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:03.412779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb0d100f-027b-4466-85f2-8913b7cc9663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045685 Sep 13 16:16:03.413337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 666/1333] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:03.606811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:03.608983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:03.614906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:03.615409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:03.615860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:03.616548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:03.617003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:03.617432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:03.647032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1207a9a2-6cf1-42cf-aca3-8cf0dcbda968 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Sep 13 16:16:03.647574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 668/1334] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:04.349123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:04.351277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:04.357121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:04.357689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:04.358026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:04.358716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:04.359231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:04.359658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:04.389757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b577379-b2bc-4e01-8919-57cdd92676a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Sep 13 16:16:04.390434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 667/1335] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:04.425378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:04.427528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:04.433814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:04.434293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:04.434729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:04.435447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:04.435902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:04.436330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:04.466276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9e28b1f-c16a-4aef-8619-1b684c0eab6b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045022 Sep 13 16:16:04.466826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 669/1336] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:04.659573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:04.661697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:04.667567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:04.668050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:04.668492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:04.669175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:04.669633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:04.670055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:04.698580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4cdf74f-713a-400f-a7c3-9e74077d99cf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Sep 13 16:16:04.699152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 668/1337] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:05.403235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:05.405486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:05.411586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:05.412234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:05.412612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:05.413424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:05.413745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:05.414167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:05.445112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78ebf067-3de3-47fd-bca5-77f3e117d0d3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Sep 13 16:16:05.445824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 670/1338] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:05.479128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:05.481284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:05.488637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:05.489114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:05.489549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:05.490234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:05.490682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:05.491134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:05.520013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c061d66-28c2-4e66-a9b8-32b6fead76dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044848 Sep 13 16:16:05.520555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 669/1339] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:16:05.711335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:05.713431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:05.719318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:05.719821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:05.720380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:05.721074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:05.721531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:05.721960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:05.752220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17b96de8-e9db-463d-900a-433e2db48c1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044910 Sep 13 16:16:05.752767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 671/1340] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:06.458147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:06.460292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:06.466080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:06.466559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:06.467018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:06.467701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:06.468143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:06.468559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:06.500574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87e2bfd5-2076-46ff-817a-48dae15609bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Sep 13 16:16:06.501151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 670/1341] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:06.532489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:06.535233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:06.541577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:06.542061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:06.542504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:06.543231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:06.543687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:06.544115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:06.572491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8800835a-3c6e-469f-8851-b2b4d068b6ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044084 Sep 13 16:16:06.573037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 672/1342] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:06.764418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:06.766504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:06.772965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:06.773439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:06.773870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:06.774539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:06.775014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:06.775440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:06.804057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6a06cbd-2a83-42b6-abe3-d92e3ddfe60a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Sep 13 16:16:06.804600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 671/1343] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:07.513128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:07.515286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:07.521578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:07.522055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:07.522486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:07.523193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:07.523634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:07.524083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:07.554073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-959cb28d-54b4-481e-bf2c-9cc8e7010c1e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Sep 13 16:16:07.559077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 673/1344] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:07.584706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:07.586879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:07.593308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:07.593793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:07.594214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:07.595656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:07.596222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:07.596651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:07.625542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5fefb4c-1da6-4e0c-8dfb-6b862ac3be19 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044750 Sep 13 16:16:07.626083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 672/1345] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:16:07.816146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:07.818203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:07.824054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:07.824525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:07.824953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:07.825716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:07.826162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:07.826581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:07.856076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-996c347c-574a-4f0d-9bad-459849276784 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Sep 13 16:16:07.856614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 674/1346] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:08.565761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:08.567950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:08.569826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:08.575018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:08.575501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:08.575936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:08.576628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:08.577075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:08.577498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:08.619624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e7ea926-3a8a-469a-bebb-eaa6c3dfb2fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057876 Sep 13 16:16:08.620181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 673/1347] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:08.637690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:08.639881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:08.646753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:08.647265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:08.647702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:08.648387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:08.648836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:08.649259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:08.678383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f4df4f8-0c74-4648-a329-1ad1c1ccb3be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044719 Sep 13 16:16:08.678944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 675/1348] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:08.868956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:08.871128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:08.877546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:08.878043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:08.878472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:08.879191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:08.879610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:08.880027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:08.911463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f76a0fa-6327-4723-a36f-f0af2a036fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Sep 13 16:16:08.912040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 674/1349] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:09.632688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:09.634807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:09.640829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:09.641382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:09.642302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:09.643192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:09.643648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:09.644076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:09.682739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52691b1d-023c-4547-b550-c0f7f9014e0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054055 Sep 13 16:16:09.686961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 676/1350] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:09.692753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:09.694876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:09.700962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:09.701443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:09.701875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:09.702565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:09.703045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:09.703470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:09.718227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:09.736072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3a9ed9a-e356-454c-a322-607ca458845c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046846 Sep 13 16:16:09.736657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 675/1351] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:09.924445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:09.926593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:09.932481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:09.932897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:09.933330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:09.934022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:09.934471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:09.934930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:09.963211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54815aff-6404-4f1b-aaed-b5a56a90af46 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Sep 13 16:16:09.963759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 677/1352] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:10.695457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:10.697699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:10.704994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:10.705475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:10.705870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:10.707076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:10.707076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:10.707429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:10.750051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:10.750646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30ba906b-b062-4cba-9f5b-d22ff1d85518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059037 Sep 13 16:16:10.752421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 676/1353] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:10.753011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:10.759756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:10.760224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:10.760659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:10.761353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:10.761800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:10.762223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:10.766003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:10.791821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1e8dccdc-3dd7-48f4-a7f0-0141eb1c7456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046546 Sep 13 16:16:10.792573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 678/1354] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:10.976093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:10.978137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:10.983965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:10.984424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:10.984856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:10.987096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:10.987548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:10.987972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:11.018152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eeacd64a-0ca9-4acb-a8aa-015ca872a683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Sep 13 16:16:11.018698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 677/1355] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:11.764101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:11.768051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:11.774676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:11.775182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:11.775604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:11.776531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:11.777038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:11.777624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:11.804523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:11.806706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:11.814253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:11.814997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:11.815632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:11.816719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:11.817298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:11.818048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:11.853943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aecb8f56-7bb3-4fef-bec1-744f054473bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053404 Sep 13 16:16:11.854811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 678/1356] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:16:11.978131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a9620e5-57ac-4e47-938a-c7f9ee4f1ade tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.218060 Sep 13 16:16:11.978680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 679/1357] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:12.030387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:12.032653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:12.038550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:12.039074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:12.039523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:12.040219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:12.040676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:12.041108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:12.070798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-947dbbb7-9cc4-4a19-8816-9188e49bc3a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Sep 13 16:16:12.071382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 679/1358] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:12.866129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:12.868293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:12.874608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:12.875223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:12.875677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:12.876376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:12.876828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:12.877253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:12.906072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cebb93d8-c73d-4b53-a3b6-f621660f244e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043796 Sep 13 16:16:12.906607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 680/1359] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:12.991132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:12.993274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:12.999662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:13.000143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:13.000592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:13.001367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:13.001821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:13.002250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:13.031248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ab4736c-babf-4e23-aeaf-1df8b236e19e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Sep 13 16:16:13.032393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 680/1360] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:13.083773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:13.085896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:13.091743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:13.092222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:13.092660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:13.093347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:13.093800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:13.094863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:13.123609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38414be0-8ba8-4f04-877d-e568ed8c0a85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Sep 13 16:16:13.124144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 681/1361] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:13.928223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:13.930366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:13.936241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:13.936716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:13.937147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:13.937891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:13.939114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:13.939537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:13.967756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d4c9475-a834-4603-ac1a-444176c463bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043422 Sep 13 16:16:13.968302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 681/1362] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:14.044118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:14.046246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:14.053447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:14.053925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:14.054365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:14.055098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:14.055555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:14.055986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:14.085472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f26fbe2f-6a97-4884-b8b6-feb2a5d2379e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045257 Sep 13 16:16:14.086023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 682/1363] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:14.136191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:14.138229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:14.144762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:14.145237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:14.145674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:14.146350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:14.146794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:14.147239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:14.177274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db25fe74-fec3-41b0-93a3-b05d5dc5d283 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Sep 13 16:16:14.177815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 682/1364] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:14.980342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:14.982460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:14.988810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:14.989289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:14.989781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:14.990473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:14.990940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:14.991419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:15.021180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18444d63-78bc-44bd-a546-7680308b8744 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044684 Sep 13 16:16:15.021718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 683/1365] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:15.098172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:15.100389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:15.106292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:15.106708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:15.107174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:15.107857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:15.108331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:15.108756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:15.137616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a3ec7c62-c9aa-4468-887a-b8d04453542f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Sep 13 16:16:15.138222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 683/1366] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:15.189955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:15.192110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:15.198361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:15.198838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:15.199310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:15.199998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:15.200456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:15.200880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:15.230112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce6cfa3f-7005-43b4-9ce6-294b01e84cb7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Sep 13 16:16:15.230648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 684/1367] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:16.034297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:16.036563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:16.048576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:16.049063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:16.049691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:16.050177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:16.050625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:16.051084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:16.080930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83f1b7d4-2b6f-4abf-bf1a-115926292be7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051306 Sep 13 16:16:16.081478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 684/1368] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:16.150838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:16.152973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:16.159897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:16.160375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:16.160813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:16.161499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:16.161948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:16.162451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:16.192734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0df08e7-f92b-4b96-bc32-35d2757992bb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Sep 13 16:16:16.193338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 685/1369] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:16.242830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:16.244932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:16.251007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:16.251497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:16.251939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:16.252630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:16.253085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:16.253516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:16.283083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f34c414-2389-4e43-a928-7192abc99964 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Sep 13 16:16:16.283632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 685/1370] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:17.093269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:17.095517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:17.103279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:17.103770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:17.104204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:17.105212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:17.105662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:17.106083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:17.136321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-745b016b-3078-47cd-bca3-82948f407f5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046882 Sep 13 16:16:17.136787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 686/1371] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:17.205203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:17.207336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:17.213618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:17.214086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:17.214508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:17.215204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:17.215644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:17.216060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:17.245167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eddb1091-d0f5-48b3-932d-0c6da84f4501 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Sep 13 16:16:17.245789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 686/1372] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:17.294736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:17.297471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:17.303474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:17.303951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:17.304382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:17.305063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:17.305509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:17.305927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:17.334763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f42e301-303c-4917-8fb0-50a80a3094af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Sep 13 16:16:17.335323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 687/1373] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:18.148768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:18.150937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:18.157704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:18.158136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:18.158571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:18.159307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:18.159758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:18.160179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:18.190799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c6af18f-de33-49b8-84e9-ea3d6f24b5f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045947 Sep 13 16:16:18.191371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 687/1374] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:18.258843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:18.261075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:18.267434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:18.267916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:18.268356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:18.269049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:18.269503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:18.269929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:18.299889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e95d9c7-1676-4b3d-81ee-d8346592044d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Sep 13 16:16:18.300537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 688/1375] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:18.347922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:18.350071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:18.356292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:18.356765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:18.357201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:18.357871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:18.358315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:18.358732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:18.387494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c2160ff-3009-4534-8ade-9e81fc3b0392 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Sep 13 16:16:18.388026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 688/1376] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:19.202889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:19.205833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:19.211685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:19.212165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:19.212753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:19.213510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:19.213968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:19.214394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:19.244561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b48b605-3e3d-44cb-9bda-bb1804e7153a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045533 Sep 13 16:16:19.245107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 689/1377] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:19.312120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:19.314852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:19.321032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:19.321505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:19.321938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:19.322617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:19.323104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:19.323530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:19.354842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c35a4702-5494-4e9e-a913-0e8a1c485518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Sep 13 16:16:19.355465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 689/1378] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:19.399880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:19.402000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:19.408336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:19.408822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:19.409260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:19.409951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:19.410402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:19.410827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:19.440089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42800231-8960-4be0-8035-3fd0b8c33177 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 13 16:16:19.440636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 690/1379] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:20.257097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:20.259700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:20.266155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:20.266629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:20.267112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:20.267995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:20.268434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:20.269010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:20.301844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c8cd18b9-9fc6-4248-bacc-ed559672e64f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048592 Sep 13 16:16:20.302402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 690/1380] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:20.367347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:20.369557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:20.376018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:20.376495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:20.376936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:20.377618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:20.378064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:20.378484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:20.409742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0f17aa1-4b56-4388-b7d7-55eb53ee68f0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 Sep 13 16:16:20.410375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 691/1381] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:20.452390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:20.455185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:20.461482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:20.461952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:20.462381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:20.463091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:20.463538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:20.463955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:20.493344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b868ee14-3ca3-4deb-8d5c-2747f0661e2a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Sep 13 16:16:20.493821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 691/1382] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:21.313827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:21.316056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:21.321950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:21.322421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:21.322854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:21.323566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:21.324020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:21.324444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:21.355651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5e1169f-d86e-4daf-9d07-b8e708c1f123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046045 Sep 13 16:16:21.356206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 692/1383] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:21.422453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:21.424715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:21.430663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:21.431179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:21.431613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:21.432301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:21.432745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:21.433171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:21.436680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:21.462837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6880667d-5b36-46a7-9086-7e9684333680 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Sep 13 16:16:21.463534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 692/1384] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:21.505143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:21.507290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:21.513599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:21.514070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:21.514501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:21.515261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:21.515711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:21.516130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:21.544804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e74df22-040d-4675-a172-4be561d4f4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Sep 13 16:16:21.545346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 693/1385] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:22.368819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:22.371151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:22.377654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:22.378137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:22.378571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:22.379409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:22.379859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:22.380283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:22.410841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-923450f2-54bf-4d26-a99f-2dcd202a69f1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045990 Sep 13 16:16:22.411440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 693/1386] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:22.475554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:22.477666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:22.483577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:22.484549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:22.484986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:22.485672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:22.486119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:22.486546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:22.511314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:22.516408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a51f6b58-6580-4e51-8bac-93b4ec0c32ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Sep 13 16:16:22.516960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 694/1387] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:22.557541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:22.559688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:22.567028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:22.567501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:22.567930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:22.568605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:22.569050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:22.569476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:22.598207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58d20ab5-ff4a-43eb-a49a-655a01cf6caf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Sep 13 16:16:22.598743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 694/1388] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:23.423184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:23.425277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:23.431121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:23.431599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:23.432031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:23.432718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:23.433165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:23.433587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:23.475464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-059fa06c-92e8-4bb5-9ded-0b322b3437a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056821 Sep 13 16:16:23.476016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 695/1389] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:23.528635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:23.530798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:23.537190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:23.537667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:23.538099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:23.538782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:23.539264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:23.539691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:23.569020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-703bc377-31bd-4b38-8142-863c6e1fd4ef tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Sep 13 16:16:23.569591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 695/1390] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:23.609489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:23.611620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:23.617854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:23.618328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:23.618757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:23.619466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:23.619920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:23.620347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:23.649706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a983bbc0-c3c1-49c6-aa8e-1e82737b5174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Sep 13 16:16:23.650242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 696/1391] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:24.488603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:24.490773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:24.496709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:24.497199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:24.497637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:24.498328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:24.498779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:24.499271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:24.528056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-285eb2c0-6bc0-42da-8b74-1236caab3f53 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044119 Sep 13 16:16:24.528619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 696/1392] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:24.581341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:24.583518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:24.585408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:24.590488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:24.591024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:24.591460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:24.592147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:24.592596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:24.593661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:24.624088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27f31913-61a6-452a-9017-438e5733e1c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Sep 13 16:16:24.625235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 697/1393] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:24.662427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:24.664574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:24.670931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:24.671439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:24.671880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:24.672571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:24.673055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:24.673489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:24.702058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25fa1702-0f20-4589-a7be-fe2a853adf6e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Sep 13 16:16:24.704731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 697/1394] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:25.540923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:25.543073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:25.549623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:25.550187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:25.550626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:25.551348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:25.551798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:25.552252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:25.583388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60ba5ed1-08da-4928-b52d-f15f2233852a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046385 Sep 13 16:16:25.584100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 698/1395] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:25.635891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:25.638018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:25.644469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:25.644939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:25.645370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:25.646045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:25.646488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:25.646927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:25.676300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2b5bbce-6852-47b5-83fe-fe57d6d737fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Sep 13 16:16:25.676940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 698/1396] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:25.716027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:25.718799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:25.725352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:25.725830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:25.726267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:25.726976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:25.727428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:25.727856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:25.756725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-930bb0ab-6ef6-4231-8d73-272b44770f8c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Sep 13 16:16:25.757269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 699/1397] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:26.596694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:26.598982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:26.604780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:26.605258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:26.605689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:26.606372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:26.606817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:26.607263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:26.637501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a7b7a69-8a19-4f2b-b4a8-9563eec5cb82 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045658 Sep 13 16:16:26.642499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 699/1398] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:26.688631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:26.690804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:26.696780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:26.697258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:26.697700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:26.698461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:26.698942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:26.699388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:26.728615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4515729-c0cd-4553-9099-19314f86ae46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Sep 13 16:16:26.729236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 700/1399] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:26.768282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:26.770418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:26.776711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:26.777185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:26.777613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:26.778296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:26.778741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:26.779194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:26.808422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1d89016-3993-4b05-ae71-458283605cf0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Sep 13 16:16:26.808961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 700/1400] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:27.650408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:27.652563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:27.658976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:27.659467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:27.659902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:27.660596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:27.661045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:27.661475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:27.691757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ccb056f-660e-4b28-ac87-aa55c4db88c3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045425 Sep 13 16:16:27.704328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 701/1401] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:27.741747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:27.743953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:27.750686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:27.751195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:27.751633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:27.752321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:27.752769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:27.753193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:27.782188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-75b5f105-3e7d-4c91-a65d-5c38b60037ec tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Sep 13 16:16:27.782839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 701/1402] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:27.820184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:27.822342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:27.828933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:27.829409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:27.829872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:27.830554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:27.831031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:27.831486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:27.861267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3edae9bb-164b-49c8-9f67-53f8462afa64 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Sep 13 16:16:27.861817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 702/1403] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:28.716248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:28.718416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:28.724656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:28.725133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:28.725569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:28.726264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:28.726713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:28.727173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:28.757859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58e5e4bd-16a6-4486-a742-389b175e2e43 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045466 Sep 13 16:16:28.758639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 702/1404] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:28.793495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:28.796275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:28.802321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:28.802802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:28.803275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:28.803971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:28.804425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:28.804853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:28.834180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bdabe052-df17-4728-ba55-e881c3229e51 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Sep 13 16:16:28.834784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 703/1405] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:28.872726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:28.874890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:28.881336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:28.881818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:28.882251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:28.882949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:28.883427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:28.883846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:28.914545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-321a5596-f412-4480-b662-94ba7c42b00f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Sep 13 16:16:28.915121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 703/1406] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:29.770987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:29.773122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:29.779366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:29.779770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:29.780248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:29.780950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:29.781600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:29.782034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:29.812902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6578c755-8b9c-4077-b49c-9809c12388bc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045894 Sep 13 16:16:29.813473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 704/1407] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:29.845658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:29.848248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:29.854159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:29.854643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:29.855143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:29.855829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:29.856286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:29.856712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:29.887236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-759a6ee5-8833-48a5-a7f5-81e01d73a4aa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Sep 13 16:16:29.887849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 704/1408] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:29.927179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:29.929311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:29.935212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:29.935702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:29.936173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:29.937491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:29.937944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:29.938373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:29.966548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6ed91fe-854b-47cf-bec3-de88fc244a0b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Sep 13 16:16:29.967129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 705/1409] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:30.825501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:30.828251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:30.834190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:30.834671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:30.835145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:30.836228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:30.836315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:30.836696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:30.867003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95dafc5f-180d-473a-abe7-b002bcbaa130 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045397 Sep 13 16:16:30.867495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 705/1410] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:30.902952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:30.902952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:30.908382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:30.908871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:30.909312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:30.910009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:30.910465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:30.910921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:30.939780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9d43f66-2dc0-4b68-b8a9-d946f912cb04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Sep 13 16:16:30.940409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 706/1411] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:30.978434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:30.980614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:30.987155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:30.987628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:30.988058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:30.988742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:30.989197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:30.989619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:31.019458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f05f0f0e-287b-42e5-a8dc-3b1428c4dbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Sep 13 16:16:31.020010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 706/1412] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:31.878741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:31.880883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:31.886980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:31.887465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:31.887903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:31.888596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:31.889050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:31.889479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:31.919971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1b43332-446d-4148-a67c-f620e6121991 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045310 Sep 13 16:16:31.921128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 707/1413] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:16:31.953464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:31.955674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:31.961694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:31.962179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:31.962618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:31.963344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:31.963794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:31.964220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:31.994533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a8ce0ae-7285-404d-bb3f-d39dbd91294b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Sep 13 16:16:31.995187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 707/1414] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:32.032473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:32.034624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:32.040609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:32.041098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:32.041542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:32.042242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:32.042699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:32.043162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:32.073579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e45b22e7-b69d-47df-adbf-f9199e512a18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Sep 13 16:16:32.074138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 708/1415] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:32.932725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:32.934854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:32.940916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:32.941394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:32.941829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:32.942510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:32.942979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:32.943404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:32.969557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:32.975314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e60b30e-4e9a-46dd-8446-2e613e1f45fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046586 Sep 13 16:16:32.975877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 708/1416] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:33.007192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:33.009490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:33.016975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:33.017492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:33.017926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:33.018699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:33.019086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:33.019510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:33.049980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34d60d87-a0fe-466a-a574-3578e3cff335 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Sep 13 16:16:33.050617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 709/1417] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:33.085651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:33.087806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:33.094873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:33.095377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:33.096079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:33.096785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:33.097233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:33.097656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:33.125907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0c60dc6-22cd-4cff-9f07-62fd2bddee00 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Sep 13 16:16:33.126453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 709/1418] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:33.988630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:33.990735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:33.996639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:33.997109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:33.997543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:33.999053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:33.999881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.000302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.029972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bfa119b-5da1-4bf6-a613-3ae7b19571d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044739 Sep 13 16:16:34.030720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 710/1419] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:34.062258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:34.064063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:34.070670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:34.071190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.071630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.072391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:34.072847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.073274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.104634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6140ebd4-179b-46f4-8b23-d6b42a930071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Sep 13 16:16:34.105211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 710/1420] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:34.137674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:34.139395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:34.140107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:34.141472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:34.146114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:34.146701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.147187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:34.147320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.147664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.147945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:34.148081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.148392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.148756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:34.148859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.149202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:34.149622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:34.165788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:34.180529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0bbc1f49-bfef-45bb-9c38-14861ca43d29 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 Sep 13 16:16:34.180767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-75eddc11-1e6d-4df2-aa8a-9c047c7e6cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045225 Sep 13 16:16:34.181095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 711/1421] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:34.181348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 711/1422] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:35.041729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:35.043888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:35.050586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.051098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.051530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.052214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.052659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.053081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.083311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-155d8ade-8589-4aa9-9da2-cba4f1025b6d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045561 Sep 13 16:16:35.083852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 712/1423] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:35.118070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:35.120291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:35.127437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.127916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.128351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.129034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.129484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.129904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.158457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c152f07-a64a-4071-a10a-20d4b3a45353 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Sep 13 16:16:35.158951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 712/1424] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:35.192836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:35.193660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:35.195043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:35.196066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:35.200884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.201931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.202510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.202632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.203047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.203270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.203479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.203728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.204159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.204268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:35.204604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:35.205136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:35.234207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a32f881-d190-4e52-93cc-3ecbbaed437d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Sep 13 16:16:35.234767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 713/1425] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:35.235536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c232477c-0fb0-44bf-8625-7e85ba1c90b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Sep 13 16:16:35.236082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 713/1426] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:36.095376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:36.097750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:36.104162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.104637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.105069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.105757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.106206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.106627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.136570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbc9ebfb-7832-4912-b65f-ffea430b4b33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045379 Sep 13 16:16:36.137119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 714/1427] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:36.171982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:36.174126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:36.180631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.181142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.181578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.182267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.182721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.183173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.217524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-17e163dc-49bd-4592-b274-94b988bd16d7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050441 Sep 13 16:16:36.218178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 714/1428] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:36.246495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:36.247443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:36.249305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:36.250207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:36.255233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.255697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.255984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.256131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.256470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.256823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.256925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.257283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.257586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:36.257697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.258043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:36.258476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:36.287119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-49f363f1-3dbd-413e-be23-c42b57c4e45e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Sep 13 16:16:36.287685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 715/1429] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:36.287860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8f091e7-1a93-44f2-a648-58e0a34b5bbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 13 16:16:36.288332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 715/1430] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:37.149361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:37.151418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:37.158153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.158636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.159110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.159926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.160244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.160666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.190256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18fcb897-5c7d-4ac9-817d-2a8ba7b94699 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044885 Sep 13 16:16:37.190796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 716/1431] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:37.229559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:37.231757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:37.239043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.239517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.239949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.240628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.241071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.241493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.270548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56b7dc5a-e0c4-4b54-9d67-31cfe9c25027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Sep 13 16:16:37.271113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 716/1432] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:37.299971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:37.300519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:37.302392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:37.302547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:37.308288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.308453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.308769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.308895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.309200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.309338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.309890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.310009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:37.310968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.311405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.311646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:37.312097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:37.342175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e2e8c27-1856-4d51-9c30-79e68c89041c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Sep 13 16:16:37.342406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf5c5fca-3420-4496-b5d6-680d8bcda25a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Sep 13 16:16:37.342815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 717/1433] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:37.343003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 717/1434] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:38.202133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:38.204363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:38.210185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.210665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.211146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.211832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.212282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.212707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.244122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcbfc2a6-829d-423c-aedc-252d57d48742 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046373 Sep 13 16:16:38.244790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 718/1435] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:38.283173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:38.285288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:38.291988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.292461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.292888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.293573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.294018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.294436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.322990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04eb65f4-384d-4a8b-9df0-de74efcc5efe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Sep 13 16:16:38.323605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 718/1436] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:38.354724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:38.354952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:38.356941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:38.357090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:38.363028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.363166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.363513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.363623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.363953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.364067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.364653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.364760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:38.365106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.365215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:38.365534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.365635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:38.395165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58eefd68-7dd2-449c-bd55-043e435791aa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Sep 13 16:16:38.395400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac91b847-1bbc-4d9b-bf29-38ad639b0ae8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Sep 13 16:16:38.395912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 719/1437] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:38.396040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 719/1438] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:39.256771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:39.258965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:39.264862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.265618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.266143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.266823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.267298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.267720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.298110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b51bdf4c-58b8-475b-9167-9126e75ded56 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045251 Sep 13 16:16:39.298655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 720/1439] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:39.336730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:39.338921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:39.340967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=94 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:39.347053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.347540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.347967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.348655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.349105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.349529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.379558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9042c3a-2a55-4682-9412-4f4162d1baa0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Sep 13 16:16:39.380110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 720/1440] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:39.407992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:39.408521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:39.410111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:39.410228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:39.416075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.416204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.416552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.416668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.416985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.417088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.417674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.417788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:39.418124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.418226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:39.418547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.418659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:39.448219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fc0bb48f-005d-4a66-b45c-53b24204cafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Sep 13 16:16:39.448565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eacef115-9e36-4986-9c51-e66c25475df0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Sep 13 16:16:39.448771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 721/1441] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:39.449115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 721/1442] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:40.310738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:40.312993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:40.318958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.319399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.319842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.320529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.320982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.321417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.351587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e205d760-99cc-4738-9ece-9d666d5bd25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045013 Sep 13 16:16:40.352441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 722/1443] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:40.392443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:40.394561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:40.400883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.401357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.401791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.402508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.402976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.403398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.432993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-faea300c-1a3e-4e5d-82b2-20031d114882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Sep 13 16:16:40.433574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 722/1444] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:40.460163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:40.460347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:40.462317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:40.462619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:40.468967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.469371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.469634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.469952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.470067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.470643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.471040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.471365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:40.471510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.471812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:40.471942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.472235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:40.501075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e77f8909-0970-487e-8982-a6fbc8c6f990 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Sep 13 16:16:40.501635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 723/1445] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:40.502250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f36ae5c-034f-4030-9d53-32928000d57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Sep 13 16:16:40.502800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 723/1446] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:41.364567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:41.366701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:41.372682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.373164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.373603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.374952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.375504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.375937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.405297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95110440-e856-4b46-a6bf-be347a22a8a0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044701 Sep 13 16:16:41.406435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 724/1447] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:41.444726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:41.446873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:41.454219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.454695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.455157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.455835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.456280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.456699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.491542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d083fba-e339-41f7-b80b-da2dd725fd83 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050663 Sep 13 16:16:41.492080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 724/1448] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:41.513541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:41.514190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:41.516711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:41.517033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:41.522738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.522892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.523263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.523411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.523695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.523810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.524385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.524498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:41.524832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.524991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:41.525252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.525371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:41.539157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:41.555154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5dda92ef-b7c8-491e-a211-11e4a0be8b0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Sep 13 16:16:41.555360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-448947ea-debb-45f0-b340-6e3bbdf1f25b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Sep 13 16:16:41.555715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 725/1449] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:41.555862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 725/1450] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:42.321909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:42.322321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:42.329143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.329620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.330049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.330731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.331212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.331634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.417273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lazy-loading 'services' on Instance uuid 325211a3-a74a-48fb-b693-e9340461ed2d {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:16:42.417742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:42.419905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:42.426796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.427308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.427816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.428505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.428951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.429367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.462486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63b22793-d623-4b01-ba32-8efbc0263cb1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048693 Sep 13 16:16:42.463103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 726/1451] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:42.498386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [8837a69d-66b0-4aa6-b08e-b21818556e02] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:16:42.504274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:42.506419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:42.512417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.512902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.513351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.514040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.515555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.515555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.545982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b79dc044-bbd0-417b-86ad-b56c7aff75fb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Sep 13 16:16:42.547118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 727/1452] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:42.567928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:42.570072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:42.576051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.576527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.576957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.578296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.578746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.579193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.582779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:42.608773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83e324f0-0dd4-44ab-abfc-5fcaa54a6d27 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Sep 13 16:16:42.609366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 728/1453] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:42.613782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:42.615867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:42.621356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.621836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.622270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.623007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:42.623460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:42.623886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:42.652940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b430b48-d0e6-444d-a9b3-05c3881725a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Sep 13 16:16:42.653484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 729/1454] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:43.475344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:43.477542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:43.484836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.485325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.485759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.486441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.486891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.487333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.507176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [8837a69d-66b0-4aa6-b08e-b21818556e02] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49958. Sep 13 16:16:43.510546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5d0ec12-8a1a-4ea6-a9ae-baceb224dad3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d/os-volume_attachments/8a912fb3-c458-4d52-984e-06017f8697d7" status: 202 len: 0 microversion: 2.1 time: 1.193025 Sep 13 16:16:43.511365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 726/1455] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:16:42 2022] DELETE /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d/os-volume_attachments/8a912fb3-c458-4d52-984e-06017f8697d7 => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:16:43.518670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5587d7ad-b700-4736-bb1c-e2eea794818e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047285 Sep 13 16:16:43.519496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 730/1456] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:16:43.559964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:43.563919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:43.569288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.569785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.570242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.570956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.571585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.572012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.602338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e44f7bfc-9e77-49a5-a627-8b450940d97d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046674 Sep 13 16:16:43.602918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 727/1457] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:43.621278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:43.623453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:43.629881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.630362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.630801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.631522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.631975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.632403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.660699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9fe82afa-a861-4e4b-91ae-df49478ed306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Sep 13 16:16:43.661250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 731/1458] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:43.665554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:43.667784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:43.674140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.674621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.675087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.675781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:43.676232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:43.676656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:43.705726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3386c178-3f17-4456-b9b1-9d532676ecf9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Sep 13 16:16:43.706270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 728/1459] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:44.530771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:44.532897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:44.539192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.539667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.540098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.540777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.541222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.541640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.570439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f400161-3d62-462c-90b6-c66d9d20aa75 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043695 Sep 13 16:16:44.570999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 732/1460] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:44.614626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:44.616850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:44.623297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.624337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.624899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.625704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.626163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.626594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.656302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9563bc1-1217-4123-b058-6521e18ea3d4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Sep 13 16:16:44.656854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 729/1461] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:44.673587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:44.675764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:44.681754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.682238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.682681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.683529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.683986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.684415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.713538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1af3f02-bb8b-4caf-9518-57b8a8b116c6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Sep 13 16:16:44.714093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 733/1462] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:44.718393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:44.721035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:44.726813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.727329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.727761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.728434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:44.728881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:44.729301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:44.757971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-173b741f-3a12-4722-ab45-3685e15e498e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Sep 13 16:16:44.758515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 730/1463] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:45.583539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:45.585660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:45.592078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.592561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.592996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.593683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.594135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.594557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.623506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ff78ff3-c734-4570-a90f-156322ebf1a4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044001 Sep 13 16:16:45.624631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 734/1464] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:45.668625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:45.670906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:45.677237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.677869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.678148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.678844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.679326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.679755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.709550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf74666a-5c9e-42ee-bad8-24b4179a857b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Sep 13 16:16:45.710092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 731/1465] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:45.725767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:45.727916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:45.733701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.734171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.734605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.735314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.735767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.736193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.764908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07ededaa-c4af-4895-ae89-033b20a13ce2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 Sep 13 16:16:45.765449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 735/1466] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:45.770490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:45.772655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:45.778514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.779036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.779478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.780953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:45.781411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:45.781840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:45.810234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78c29a40-bd9b-45f6-8825-15351c85d9c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Sep 13 16:16:45.810789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 732/1467] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:46.636093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:46.638170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:46.645243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.645721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.646156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.646859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.647313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.647736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.676785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fca9f0ab-2afd-48dd-852d-efab84e147c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044795 Sep 13 16:16:46.677319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 736/1468] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:46.722742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:46.724960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:46.731361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.731879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.732316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.733014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.733617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.734036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.763463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49ca563d-074b-474a-9d1e-efcea934e17f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Sep 13 16:16:46.764019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 733/1469] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:46.776456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:46.778630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:46.784947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.785425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.785858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.786535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.787007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.787426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.816461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc4a1aab-f531-4dce-8f44-ff992f4c1745 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Sep 13 16:16:46.817010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 737/1470] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:46.823004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:46.825135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:46.831681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.832160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.832595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.833277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:46.833725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:46.834148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:46.864660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5b115e11-9dd3-4df8-b871-134b3135c8e3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Sep 13 16:16:46.869490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 734/1471] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:47.689853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:47.692277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:47.698641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.699194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.699633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.700315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.700759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.701178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.731355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7df0ee5-c404-4d18-97d8-946b0a315b26 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046097 Sep 13 16:16:47.731898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 738/1472] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:47.776224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:47.778565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:47.785220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.785707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.786147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.786843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.787323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.787752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.817422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5221201b-aee5-47a5-9fe3-3a0a5647dcd7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045072 Sep 13 16:16:47.817972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 735/1473] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:47.828861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:47.831011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:47.836844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.837326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.837762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.838447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.838919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.839369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.868647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a51194e-41f7-4d60-8b43-0dda51b18f11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Sep 13 16:16:47.869185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 739/1474] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:47.876983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:47.879168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:47.885040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.885523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.885967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.886657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:47.887150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:47.887582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:47.915988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-20d4bb29-3616-40c6-ba79-2129565292e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Sep 13 16:16:47.916541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 736/1475] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:48.744200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:48.746331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:48.752843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.753325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.753759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.754445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.754906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.755343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.784614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6be27063-d775-4319-9b27-0887ce8488ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044731 Sep 13 16:16:48.785158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 740/1476] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:48.830032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:48.832192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:48.838432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.838931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.839366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.840104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.840552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.840973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.871046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7576d74d-24e4-4c68-82f3-02716408c6b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045383 Sep 13 16:16:48.871597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 737/1477] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:48.880845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:48.883085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:48.889507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.889991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.890431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.891175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.891631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.892062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.923482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a6efc6f-9801-4041-8da0-f23d9287e03d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046411 Sep 13 16:16:48.923967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 741/1478] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:48.928667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:48.930844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:48.937370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.937852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.938292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.939131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:48.939587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:48.940018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:48.968947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e7f4f94-71ee-4866-a240-b4820623c427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Sep 13 16:16:48.969492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 738/1479] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:49.797231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:49.799417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:49.806023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.806503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.806970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.807660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.808678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.809111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.838838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76c6164f-b712-43cf-999d-ed03079d4469 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045683 Sep 13 16:16:49.839409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 742/1480] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:49.883687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:49.885819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:49.892561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.893045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.893480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.894168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.894618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.895073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.925035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d03f3a55-7966-4b97-83a3-23e5f985cfe5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Sep 13 16:16:49.925592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 739/1481] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:49.935661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:49.937805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:49.943569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.944036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.944463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.945137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.945582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.946001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.975043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-556eebff-8563-43ca-b456-69fa798811a3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Sep 13 16:16:49.975623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 743/1482] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:49.980566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:49.983453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:49.989285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.989765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.990202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:49.990888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:49.991359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:49.991783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:50.020255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c8078e5-9ce0-462a-994a-785ad3d2b163 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Sep 13 16:16:50.020799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 740/1483] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:50.851939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:50.854040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:50.861437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:50.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:50.862334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:50.863047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:50.863492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:50.863910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:50.890305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:50.895551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-748a1a0d-432f-461c-b50e-82d328f49de7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047661 Sep 13 16:16:50.896098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 744/1484] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:50.937951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:50.940172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:50.946576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:50.947101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:50.947541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:50.948239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:50.948692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:50.949120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:50.962863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:50.980201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88e30a4f-0e36-4856-bb14-d4debe5a1da4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Sep 13 16:16:50.980755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 741/1485] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:50.988615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:50.990711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:50.996489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:50.996960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:50.997389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:50.998068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:50.999737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:51.000168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:51.030047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eab38bf3-8e13-47b0-a0d6-98e559eec633 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Sep 13 16:16:51.030607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 745/1486] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:51.031996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:51.034180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:51.040073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:51.040561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:51.041001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:51.041716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:51.042161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:51.042589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:51.072916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9628ede-4a4e-4b25-9d2d-74f8555452a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Sep 13 16:16:51.073474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 742/1487] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:51.908031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:51.910143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:51.916551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:51.917021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:51.917489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:51.918168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:51.918617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:51.919073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:51.948835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eff5ccbb-ebf9-4a0f-8902-4ee893e90780 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044772 Sep 13 16:16:51.949374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 746/1488] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:51.992522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:51.994676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:52.003302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.003794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.004232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.004934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.005390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.005817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.036165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2d26154-84f8-4c72-9495-d9823a5996f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Sep 13 16:16:52.036980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 743/1489] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:52.041761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:52.043911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:52.046218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:52.051657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.052134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.052567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.053252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.053698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.054117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.084396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-122a32b8-f4f6-4e64-89e2-2b4bebc46fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Sep 13 16:16:52.084940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 747/1490] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:52.085616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:52.087844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:52.093961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.094708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.095181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.095873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.096328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.096757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.125836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-350f1d29-6604-4ad6-863e-206cb442e6de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Sep 13 16:16:52.126375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 744/1491] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:52.961525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:52.963729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:52.971306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.971785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.972215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:52.972894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:52.973337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:52.973760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.002718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c6e5d08-c4fb-473c-ab73-ba6028d6aed9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045166 Sep 13 16:16:53.003287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 748/1492] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:53.049331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:53.051593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:53.058105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:53.058595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:53.059063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.059762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:53.060217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:53.060646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.091761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25ce4db3-bd3d-4d93-b5f0-fc4b37bdf005 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 Sep 13 16:16:53.098234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 745/1493] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:53.098341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:53.099917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:53.105759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:53.106318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:53.106911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.107827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:53.108277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:53.108748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.137035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b48c152-9abe-4c66-8cf5-a41e5c6875f8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Sep 13 16:16:53.137737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:53.137868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 749/1494] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:53.140464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:53.146255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:53.146728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:53.147200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.147884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:53.148335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:53.148757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:53.177689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af83ca12-b01f-463d-88cd-856e1ada35f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Sep 13 16:16:53.178166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 746/1495] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:54.015915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:54.018062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:54.024375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.024877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.025283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.025961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.026408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.026830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.056105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32f0f5ad-f1dd-4fcb-afb7-86532f49e2d0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044205 Sep 13 16:16:54.056654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 750/1496] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:54.104733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:54.106919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:54.113816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.114298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.114730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.115466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.115913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.116331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.146143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2fdc5baf-d8f0-4e82-b2ae-842f72a81941 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045253 Sep 13 16:16:54.146961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 747/1497] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:54.150495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:54.152654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:54.159227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.159711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.160152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.160849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.161306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.161734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.190339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:54.190886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34dfe5f2-917e-4918-9794-dc79e6bdbeb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Sep 13 16:16:54.191467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 751/1498] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:54.192571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:54.198406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.198879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.199342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.200021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:54.200492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:54.200914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:54.229963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e07ee7c6-0a9c-48d9-a0d6-88594acbc62c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Sep 13 16:16:54.230504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 748/1499] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:55.069525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:55.071714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:55.078634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.079135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.079567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.080258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.080701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.081121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.109822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec38e72a-5727-4ef7-b17c-04118a9b3d9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044261 Sep 13 16:16:55.110380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 752/1500] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:55.158128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:55.160229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:55.166558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.167430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.167873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.168568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.169031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.169461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.202215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-043211dd-83aa-4cc5-b006-d283d6abf433 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047672 Sep 13 16:16:55.206790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 749/1501] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:55.206945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:55.206945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:55.211980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.212470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.212905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.213854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.214191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.214620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.242018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:55.245800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:55.247777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3595b976-b8c5-44a4-be5b-4e9db6fc332a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048928 Sep 13 16:16:55.249173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 753/1502] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:55.252611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.253103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.253545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.254292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:55.254747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:55.255198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:55.284888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-503545e6-59d5-40f8-8ee0-7fd6f9fea3e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047144 Sep 13 16:16:55.285438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 750/1503] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:56.122222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:56.125006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:56.131398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.132125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.132564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.133253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.133709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.134136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.162546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5fa6aa8-1add-4e12-80cb-d7a7716e924d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 Sep 13 16:16:56.163125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 754/1504] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:56.213567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:56.215769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:56.223109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.223596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.224035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.224721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.225177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.225605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.255827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-acfc4eb8-595f-46f9-b1e3-09b7afd86ae3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Sep 13 16:16:56.256552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 751/1505] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:56.261038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:56.263258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:56.269612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.270090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.270554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.271269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.271719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.272244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.298452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:56.300633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:56.306534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.307073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.307500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.308193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:56.308461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c3083a4-3d21-4dce-a645-e1408b85829b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 Sep 13 16:16:56.308649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:56.309258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 755/1506] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:56.309378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:56.338804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e71c051-13a0-4540-b84e-671319c3a070 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Sep 13 16:16:56.339386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 752/1507] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:57.175925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:57.177974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:57.184388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.184865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.185956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.186640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.187128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.187554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.216132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f16b229-1c05-4b64-affa-508cb54d241f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044298 Sep 13 16:16:57.217207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 756/1508] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:57.268608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:57.270718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:57.277062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.277535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.277966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.278646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.279136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.279554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.307742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9033e961-df4d-4a44-b582-fb5b1906adbe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Sep 13 16:16:57.308287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 753/1509] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:57.320773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:57.323055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:57.329618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.330398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.330841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.331566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.332025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.332460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.351734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:57.354144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:57.360941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.361424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.361861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.362566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:57.363264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:57.363695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:57.364335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a235efd9-ee87-4847-bb0b-e5ac4a092cd4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Sep 13 16:16:57.365038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 757/1510] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:57.392899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94682d9d-4829-411c-87eb-601d4f6e6243 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Sep 13 16:16:57.393475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 754/1511] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:58.228874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:58.231267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:58.237766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.238246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.238685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.239404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.239856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.240279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.269949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98eabcec-da1f-4ff8-99ef-81f41b6a3839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045116 Sep 13 16:16:58.270499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 758/1512] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:16:58.320134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:58.322412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:58.330276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.330751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.331323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.332192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.332734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.333326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.369714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a7b405c-c940-422c-9fe0-ea1ef451e5f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053543 Sep 13 16:16:58.371546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 755/1513] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:58.377247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:58.379404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:58.385821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.386321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.386754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.387463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.387913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.388877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.406277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:58.408566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:58.414942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.414942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.420032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71df7fcd-b472-4ab2-890c-c282ac0d681c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046948 Sep 13 16:16:58.420314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.420999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 759/1514] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:58.425506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:58.425991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:58.426440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:58.456879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3c1aae4-d36b-4cce-bf78-c20f7b641df6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056096 Sep 13 16:16:58.457421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 756/1515] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:16:59.282042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:59.284133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:59.290150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.290616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.291085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.291762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.292202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.292620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.322623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71cbc5fa-b11b-4164-92b7-f09bbecdc7a7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044822 Sep 13 16:16:59.323194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 760/1516] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:16:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:16:59.383802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:59.385918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:59.392951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.393419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.393954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.394685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.395177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.395612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.425627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b531c86-6f31-49ba-af95-7245e24804b5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Sep 13 16:16:59.426178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 757/1517] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:59.432901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:59.435625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:59.441887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.442376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.442816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.443548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.444002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.444635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.461560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:59.470061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:16:59.472742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:16:59.476634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa0ea024-8a0f-400e-bf18-744536efd2e8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Sep 13 16:16:59.481212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 761/1518] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:16:59.481361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.481361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.481361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.481361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:16:59.481723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:16:59.481723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:16:59.484300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:16:59.512813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e4413ba1-fbdc-45c4-b764-373976366a7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Sep 13 16:16:59.514021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 758/1519] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:16:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:00.335926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:00.338056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:00.345323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.345803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.346240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.346958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.347436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.347884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.377248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1984d29-e10a-4126-9c0f-1591ce72eabc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045327 Sep 13 16:17:00.377797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 762/1520] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:17:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:17:00.438098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:00.440305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:00.446722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.447237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.447674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.448361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.448808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.449230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.478593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-daaa1c11-87b6-462f-aa8f-8ec723a3c41a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Sep 13 16:17:00.479171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 759/1521] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:00.488856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:00.490997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:00.496969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.498041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.498505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.499215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.499660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.500080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.526847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:00.529821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:00.530374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fed6798c-1ef5-47be-802f-4177de0d6f61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Sep 13 16:17:00.531173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 763/1522] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:00.541342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.541342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.541342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.541342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:00.541728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:00.541728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:00.569207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abb32e44-dcc3-46e6-8def-96d8b0ca7a68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Sep 13 16:17:00.570316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 760/1523] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:01.389976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:01.392150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:01.398525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.399034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.399506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.400198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.400647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.401068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.430156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65e0ca4e-ae24-4e8e-a375-b4085e2ae3ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044321 Sep 13 16:17:01.430692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 764/1524] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:17:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:17:01.491164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:01.493287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:01.500355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.500830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.501260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.501934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.502381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.502800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.533732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ae08d4b-5c35-4cd6-9e0e-22c40b8448b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Sep 13 16:17:01.533732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 761/1525] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:01.543959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:01.546744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:01.552863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.553351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.553787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.554485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.555057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.555489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.582639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:01.585102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:01.591919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.592076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02c93851-89d8-4db7-85a0-7858a7c08607 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046826 Sep 13 16:17:01.592649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 765/1526] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:01.593114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.593631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.594651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:01.595199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:01.595689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:01.627577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a25615e-fbc8-473a-838e-a43b10d0c5d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Sep 13 16:17:01.628122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 762/1527] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:02.442266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:02.444425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:02.450793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.451301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.452473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.453178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.453631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.454056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.483115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9c86acb-39c8-4611-b551-1695bd6ed65b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044705 Sep 13 16:17:02.483658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 766/1528] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:17:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:17:02.545222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:02.547408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:02.553798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.554272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.554705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.555413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.555865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.556289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.586606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-966b1a4c-d3cf-4a84-a011-098159b74c44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Sep 13 16:17:02.587185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 763/1529] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:02.604804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:02.606984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:02.612929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.613412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.613846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.614534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.615006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.615436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.640440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:02.642776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:02.646013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-625ab7d5-dcb8-46d5-9a3b-8a57e610be0d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Sep 13 16:17:02.646760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 767/1530] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:02.648714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.649308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.649633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.650339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:02.650794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:02.651250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:02.681824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce2cec16-8835-4cc9-9649-2cc55d31dc7a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Sep 13 16:17:02.682368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 764/1531] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:03.495482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:03.497735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:03.504989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.505469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.505907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.506598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.507091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.507521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.538351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-618e8883-47d7-4285-ae93-8223ad510cd4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046832 Sep 13 16:17:03.538914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 768/1532] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:17:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:17:03.598773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:03.600961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:03.607472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.608683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.609130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.609812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.610255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.610670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.639687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7237d0c7-64cf-4541-8bdf-8736ace2540c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Sep 13 16:17:03.640214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 765/1533] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:03.658103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:03.660310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:03.666091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.666559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.667024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.667703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.668148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.668566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.694669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:03.696983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:03.699957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1abaeff2-9f78-4fa9-9366-f5323dc8de57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046233 Sep 13 16:17:03.700845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 769/1534] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:03.702882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.703554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.703995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.704846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:03.705438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:03.705899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:03.736206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-102d8f53-070d-4227-94a5-ccbd1fd2057e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 13 16:17:03.736753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 766/1535] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:04.550519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:04.552683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:04.559043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.559529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.559994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.560687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.561172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.561597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.591850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5e4dac5-43db-4999-b469-5e62cc0ff4ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045602 Sep 13 16:17:04.593036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 770/1536] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:17:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:17:04.652149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:04.654264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:04.661309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.661789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.662243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.662930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.663390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.663849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.692767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-99e149e9-3b35-4706-af6f-e7246774c6e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Sep 13 16:17:04.693312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 767/1537] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:04.712751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:04.714907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:04.721187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.721668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.722106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.722799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.723281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.723710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.748922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:04.751106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:04.755993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ed1387f-1158-416d-9d58-8fe48d3e6f20 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Sep 13 16:17:04.756789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 771/1538] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:04.757124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.757610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.758053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.758756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:04.759235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:04.759700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:04.790362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb90ce31-7a8a-4e38-8d33-8a715e0ea78a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Sep 13 16:17:04.790930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 768/1539] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:05.605269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:05.607379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:05.614066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.614537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.615001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.615685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.616128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.616544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.646581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfa9690b-e3a6-44f8-96d3-8efbc7e3b20b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045448 Sep 13 16:17:05.647172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 772/1540] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Sep 13 16:17:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:17:05.705701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:05.707874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:05.714457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.714957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.715393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.716103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.716548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.716967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.745851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93c5c3dd-8f8d-45f8-80e4-88a4a1c507ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 13 16:17:05.746385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 769/1541] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:05.768839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:05.771006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:05.776870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.777354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.777793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.778481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.778958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.780203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.802386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:05.805004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:05.806862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:05.810760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35071d17-d44f-4db7-a336-046aed1af399 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Sep 13 16:17:05.811785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 773/1542] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:05.812820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.814674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.814674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.814674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:05.815095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:05.815528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:05.846297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbe79db8-f241-4822-9641-c6d14828485b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Sep 13 16:17:05.846856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 770/1543] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:06.659192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:17:06.661318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:06.667798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.668265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.668693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.669367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.669812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.670865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.696314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [f8313779-e08e-4f3c-a61a-fb3f2c0e036a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:17:06.758883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:06.761075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:06.768291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.768774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.769220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.769907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.770360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.770783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.800465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83a1675b-a601-4d0d-b6ed-78424c3cecfc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Sep 13 16:17:06.801034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 771/1544] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:06.822776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:06.824955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:06.831155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.831636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.832074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.832757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.833213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.833642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.863271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b28523ae-2331-4b17-9390-49dcaae55a54 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Sep 13 16:17:06.863824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 772/1545] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:06.868504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:06.870606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:06.879974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.880462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.880899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.881596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:06.882046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:06.882471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:06.913587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9db926d0-cf53-4cd3-97a0-1e073843eea1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048767 Sep 13 16:17:06.914278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 773/1546] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:07.704302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [f8313779-e08e-4f3c-a61a-fb3f2c0e036a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50188. Sep 13 16:17:07.757535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb6b7c35-d39b-4c5b-a07e-ae671888023e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/action" status: 200 len: 37561 microversion: 2.20 time: 1.102438 Sep 13 16:17:07.758181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 774/1547] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Sep 13 16:17:06 2022] POST /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68/action => generated 37561 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:17:07.813535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:07.815737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:07.822158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:07.822638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:07.823111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:07.823798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:07.824251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:07.824698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:07.849706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:07.854774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd9dd9b8-126d-4d28-b645-9daf609385fe tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Sep 13 16:17:07.855556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 774/1548] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:07.876253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:07.878474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:07.885322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:07.885796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:07.886230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:07.886929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:07.887379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:07.887803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:07.918464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4d061630-2c66-4aeb-b58c-e7450bfe50c2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047080 Sep 13 16:17:07.919040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 775/1549] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:08.006961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:08.009170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:08.015404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:08.015882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:08.016315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:08.016993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:08.017439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:08.017860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:08.048373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d3b9871-361a-4c37-a9b6-c202a6f809b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126442 Sep 13 16:17:08.048927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 775/1550] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:08.867330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:08.869490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:08.876322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:08.876801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:08.877232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:08.877942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:08.878402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:08.878821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:08.910688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-430979db-96d3-4b0b-8fb5-52ee90779ef6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047294 Sep 13 16:17:08.911544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 776/1551] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:08.930805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:08.933005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:08.939488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:08.939966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:08.940399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:08.941082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:08.941529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:08.941951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:08.971965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46a167e5-094f-41dc-9d1d-adefa94aeaaa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Sep 13 16:17:08.972512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 776/1552] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:09.060894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:09.063174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:09.069412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:09.069883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:09.070311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:09.071028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:09.071479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:09.071898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:09.101730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-862bab79-3eb5-4369-8bea-612d9a444119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Sep 13 16:17:09.102266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 777/1553] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:09.923911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:09.926051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:09.932037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:09.932633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:09.932943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:09.933625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:09.934075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:09.934498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:09.964967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d975c07f-3bb4-4489-882a-044c2276ad3d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Sep 13 16:17:09.965522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 777/1554] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:09.983888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:09.986047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:09.988550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:17:09.988695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:17:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:17:09.993767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:09.994239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:09.994672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:09.995385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:09.995831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:09.996251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:10.014847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:10.029786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9594c067-9f18-4fea-8b68-12e781a9a710 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049948 Sep 13 16:17:10.030362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 778/1555] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:10.114140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:10.116385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:10.122214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:10.122706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:10.123918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:10.124703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:10.125148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:10.125623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:10.155738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d671dba6-6509-4f2c-b224-48d4b724bd80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 13 16:17:10.156279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 778/1556] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:10.977621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:10.979739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:10.986171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:10.986730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:10.987170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:10.987852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:10.988301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:10.988720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:11.018450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfc2f8df-e1ec-451f-a7e7-7a88f77d0518 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Sep 13 16:17:11.019035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 779/1557] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:11.041627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:11.043792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:11.051471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:11.051954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:11.052389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:11.053091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:11.053544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:11.053973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:11.084491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8966c8b4-3cbe-4319-925c-9772e735c59d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046711 Sep 13 16:17:11.085070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 779/1558] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:11.167917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:11.170146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:11.177026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:11.177511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:11.177950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:11.178708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:11.179196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:11.179621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:11.208639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-051f2bcf-c939-4d79-b754-1c68182b11c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Sep 13 16:17:11.209213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 780/1559] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:12.031525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:12.033581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:12.040009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:12.040498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:12.040942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:12.041640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:12.042162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:12.042518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:12.072218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ff83317-686f-4213-b734-86613cf682a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045808 Sep 13 16:17:12.072773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 780/1560] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:12.097630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:12.099910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:12.106268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:12.106751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:12.107307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:12.108004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:12.108458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:12.108929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:12.137756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b83de3d-97c5-4b17-a0ed-9d2582591fb9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Sep 13 16:17:12.138856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 781/1561] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:12.221592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:12.223751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:12.229635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:12.230117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:12.230578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:12.231295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:12.231750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:12.232384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:12.262238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8ef28bfe-3cff-4c80-bf7f-5ab3f28f4683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Sep 13 16:17:12.262937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 781/1562] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:13.085241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:13.087395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:13.093724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:13.094207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:13.094649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:13.095366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:13.095822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:13.096249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:13.125771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb5128b4-c8f1-4ed9-9dbe-dff8539448c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Sep 13 16:17:13.126385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 782/1563] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:13.214505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:13.216790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:13.223118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:13.223603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:13.224038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:13.224730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:13.225188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:13.225608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:13.254990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-15277203-faed-461b-9ca6-9d13b4412783 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109342 Sep 13 16:17:13.255811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 782/1564] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:13.275616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:13.277819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:13.283847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:13.284324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:13.284756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:13.285429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:13.285875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:13.286302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:13.315913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c147f8b8-c487-4a8c-ac56-341773ad79bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Sep 13 16:17:13.316451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 783/1565] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:14.137279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:14.139767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:14.145630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:14.146110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:14.146542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:14.147258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:14.147711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:14.148135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:14.176901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7cd2e77-e2dc-4283-b9ab-c80439ef8010 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Sep 13 16:17:14.177454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 783/1566] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:14.267140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:14.269287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:14.275907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:14.276389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:14.276828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:14.277521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:14.277974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:14.278400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:14.308139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9929eb6-b229-40fc-980c-d392d84bb1ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Sep 13 16:17:14.308698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 784/1567] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:14.328808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:14.330974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:14.336755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:14.337227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:14.337677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:14.338352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:14.338797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:14.339245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:14.368185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31b9aeb0-7b15-4381-80c9-e545cd8ae1f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Sep 13 16:17:14.368727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 784/1568] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:15.190005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:15.192103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:15.197997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:15.198470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:15.198926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:15.199587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:15.200031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:15.201077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:15.229631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8189a1cb-9c50-437f-aa48-8424035c7461 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Sep 13 16:17:15.230175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 785/1569] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:15.320463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:15.322640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:15.329578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:15.330159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:15.330487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:15.331274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:15.331728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:15.332152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:15.361795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96754525-e4ff-4036-86ee-ba9e8cad7b9e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 13 16:17:15.362357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 785/1570] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:15.380829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:15.382973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:15.390043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:15.390523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:15.390980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:15.391667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:15.392116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:15.392540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:15.421509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ba40f44-bdc4-4fe6-b437-1eab158196b9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Sep 13 16:17:15.422081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 786/1571] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:16.242239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:16.244458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:16.250834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:16.251349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:16.251788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:16.252479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:16.252934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:16.253367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:16.282386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8974912b-8973-4f06-996d-deee0d9778db tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Sep 13 16:17:16.282955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 786/1572] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:16.374505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:16.376687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:16.382687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:16.383286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:16.383625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:16.384310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:16.384761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:16.385188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:16.415959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b224fdf8-b04c-409a-8fe5-05fd69047c18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Sep 13 16:17:16.416523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 787/1573] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:16.434363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:16.436942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:16.443683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:16.444159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:16.444614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:16.445311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:16.445760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:16.446184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:16.476918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7053afb-c667-41ac-ba4e-e769f08def65 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047168 Sep 13 16:17:16.477454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 787/1574] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:17.295507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:17.297612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:17.303493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:17.304121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:17.304555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:17.305228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:17.305670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:17.306090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:17.335283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1fc55e91-175f-4751-9175-e9eea5c689c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Sep 13 16:17:17.335824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 788/1575] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:17.428398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:17.430520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:17.437252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:17.437830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:17.438141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:17.438824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:17.439298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:17.439718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:17.471150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edefabdc-2777-4ed9-ad1a-c7301cdee542 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046536 Sep 13 16:17:17.471720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 788/1576] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:17.489497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:17.491633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:17.502205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:17.502205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:17.502205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:17.502205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:17.502606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:17.502606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:17.529707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-795fb2d4-dbe4-469f-871a-b2709d085516 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Sep 13 16:17:17.530255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 789/1577] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:18.348007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:18.350134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:18.356062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:18.357205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:18.357641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:18.358326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:18.359045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:18.359471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:18.391341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2246d8d8-5b73-4244-ad28-4eb393277a2c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Sep 13 16:17:18.391878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 789/1578] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:18.484068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:18.486241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:18.492706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:18.493270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:18.493607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:18.494327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:18.494779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:18.495234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:18.526396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d6afde0-425b-41fc-a540-52259e29691b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Sep 13 16:17:18.526980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 790/1579] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:18.541617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:18.544331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:18.550914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:18.551407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:18.551843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:18.552538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:18.552998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:18.553420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:18.583792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b62d66cd-b230-43f0-a6a9-20f20d21ccbe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046161 Sep 13 16:17:18.584337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 790/1580] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:19.404083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:19.406254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:19.412174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:19.412658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:19.413102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:19.413801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:19.414234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:19.414650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:19.444762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc44166a-d9f0-4ec1-8bde-0a3efdacaf77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Sep 13 16:17:19.445309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 791/1581] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:19.538616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:19.540792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:19.547268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:19.547871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:19.548171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:19.548856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:19.549301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:19.549721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:19.563662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:19.580589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-233130c7-531b-4c48-8455-fbc0244c4db1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Sep 13 16:17:19.581297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 791/1582] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:19.597478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:19.599645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:19.606126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:19.606939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:19.607192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:19.607880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:19.608327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:19.608751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:19.637876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96286be0-069e-4245-9ff0-fa5fd3e4b729 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Sep 13 16:17:19.638423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 792/1583] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:20.457293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:20.459465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:20.465920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:20.466555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:20.466986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:20.467941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:20.468392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:20.468820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:20.498351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb4c0da7-82ec-4f46-ac07-99f3b0f33c97 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Sep 13 16:17:20.498906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 792/1584] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:20.593338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:20.595510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:20.601433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:20.601995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:20.602340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:20.603068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:20.603526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:20.603957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:20.634327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b95833f2-72db-439d-8904-a3ee9c86715d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Sep 13 16:17:20.634705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 793/1585] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:20.649611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:20.651856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:20.658759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:20.659286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:20.659724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:20.660420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:20.660877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:20.661329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:20.691382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edb8d570-8949-4d2d-8103-2e1f70607573 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Sep 13 16:17:20.691921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 793/1586] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:21.510746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:21.512973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:21.519557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:21.520035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:21.520472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:21.521158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:21.521608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:21.522034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:21.551112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4b77957-1b87-4a98-a486-da936d7ebacd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Sep 13 16:17:21.551657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 794/1587] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:21.646787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:21.649114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:21.655111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:21.655685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:21.656164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:21.656859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:21.657313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:21.657741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:21.689277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef80d66d-f083-4ddc-b265-7e8d5eaee1f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046557 Sep 13 16:17:21.689842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 794/1588] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:21.703508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:21.705642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:21.711905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:21.712387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:21.712861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:21.713556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:21.714007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:21.714465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:21.718387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:21.744369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7991a259-7900-42b5-b424-0b9fbe4c6951 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Sep 13 16:17:21.744918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 795/1589] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:22.562650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:22.564794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:22.570663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:22.571238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:22.571668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:22.572340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:22.572782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:22.573200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:22.602745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07f3070e-2785-4b39-982c-e6d51378a4c4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Sep 13 16:17:22.603313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 795/1590] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:22.702108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:22.704394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:22.706255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:22.712005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:22.712465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:22.712901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:22.713599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:22.714046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:22.714470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:22.743549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57d1e9b2-f080-43c2-90ea-3d4e33b70ecb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Sep 13 16:17:22.744092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 796/1591] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:22.757132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:22.759575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:22.766441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:22.766941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:22.767377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:22.768059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:22.768504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:22.768920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:22.797131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57a1fd8c-81cb-4193-9915-63b72f969abf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Sep 13 16:17:22.797680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 796/1592] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:23.614186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:23.616342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:23.622231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:23.623447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:23.623886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:23.624571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:23.625023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:23.625449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:23.654208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f80078b8-54e5-4941-866b-fb25100cd8eb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Sep 13 16:17:23.654742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 797/1593] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:23.756758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:23.759018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:23.766297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:23.766779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:23.767241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:23.767928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:23.768378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:23.768797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:23.798419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-538a6ba7-099c-4a90-9eca-fda74ef8b4cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Sep 13 16:17:23.798979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 797/1594] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:23.809283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:23.812155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:23.818647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:23.819236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:23.819680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:23.820374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:23.820826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:23.821252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:23.851318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a969f04f-c43c-4336-9324-f7536c040515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Sep 13 16:17:23.852017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 798/1595] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:24.666702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:24.668948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:24.675546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:24.676024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:24.676457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:24.677140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:24.677585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:24.678035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:24.706968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc6c3eb2-66e1-42b9-8601-eb3955506c19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Sep 13 16:17:24.707516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 798/1596] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:24.811715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:24.813813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:24.820328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:24.820833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:24.821272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:24.821970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:24.822501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:24.822847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:24.852201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-081ec8be-ae86-40e8-b331-0577c3627084 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Sep 13 16:17:24.852759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 799/1597] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:24.863805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:24.865970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:24.873310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:24.873799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:24.874239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:24.874951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:24.875435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:24.875858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:24.905248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50791925-c72a-44dc-b4f1-50382b9a2022 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Sep 13 16:17:24.905809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 799/1598] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:25.719940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:25.722097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:25.728049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:25.728531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:25.728974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:25.729669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:25.730124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:25.730554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:25.759522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36374d2c-f8d9-430d-b6ab-a30ba7f86f35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Sep 13 16:17:25.760076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 800/1599] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:25.864843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:25.867054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:25.873972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:25.874444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:25.874875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:25.875578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:25.876029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:25.876448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:25.905768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1524e505-47aa-40e5-8b30-16f756a271c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Sep 13 16:17:25.906306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 800/1600] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:25.917648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:25.919841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:25.926218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:25.926728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:25.927200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:25.927975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:25.928440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:25.928872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:25.959013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f3d6112-fe0f-426f-9198-216aa0eaaf39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Sep 13 16:17:25.959666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 801/1601] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:26.772927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:26.775084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:26.782010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:26.782484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:26.782941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:26.783624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:26.784068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:26.784525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:26.813353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa64c5f2-19fc-449d-808d-70cc9aa9dd01 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Sep 13 16:17:26.813894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 801/1602] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:26.917905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:26.920150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:26.926394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:26.926876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:26.927347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:26.928048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:26.928500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:26.928932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:26.959401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80c23802-6f99-4195-89b9-fdb8e54ecbed tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Sep 13 16:17:26.959951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 802/1603] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:26.972401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:26.974528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:26.980881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:26.981367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:26.981806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:26.982499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:26.982979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:26.983435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:27.012460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ea371db-13b3-465c-ae6f-0a99da29ba76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Sep 13 16:17:27.013025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 802/1604] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:27.825780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:27.827984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:27.833976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:27.834451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:27.834885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:27.835589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:27.836039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:27.836493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:27.866055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d20b3919-5c4e-4b73-b4f5-f096cab2d913 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Sep 13 16:17:27.866606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 803/1605] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:27.972448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:27.974581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:27.980626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:27.981111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:27.981563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:27.982236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:27.982687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:27.983140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:28.012884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbaafc12-5dd9-4965-ae5e-6fc6d61b062f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Sep 13 16:17:28.013429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 803/1606] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:28.025320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:28.027531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:28.034430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:28.034925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:28.035375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:28.036060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:28.036511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:28.036967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:28.067852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90dc32f4-cdb3-48d5-a149-e21b4df0500d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Sep 13 16:17:28.068421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 804/1607] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:28.878471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:28.880673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:28.887589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:28.888071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:28.888537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:28.889229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:28.889680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:28.890105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:28.921507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e3a337b-a456-480c-8376-77fe5b194e96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Sep 13 16:17:28.922087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 804/1608] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:29.025032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:29.027234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:29.034118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:29.034598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:29.035064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:29.035760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:29.036214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:29.036667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:29.070999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-567ec8a0-3041-4913-b6fb-4ab791cae091 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Sep 13 16:17:29.070999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 805/1609] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:29.081385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:29.083547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:29.089815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:29.090294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:29.090720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:29.091427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:29.091871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:29.092291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:29.121895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc270acb-23e6-40df-a439-106c06842f45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Sep 13 16:17:29.122457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 805/1610] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:29.933980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:29.936163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:29.942454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:29.942973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:29.943409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:29.944087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:29.944529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:29.944944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:29.974476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-937c316e-1d77-4068-9c0a-48276bc35d7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 13 16:17:29.975050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 806/1611] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:30.083796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:30.085932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:30.092183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:30.092662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:30.093102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:30.093790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:30.095095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:30.095642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:30.124742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe0c03e0-75d9-4837-9004-29ae396057fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Sep 13 16:17:30.125803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 806/1612] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:30.135196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:30.137382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:30.144435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:30.144912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:30.145346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:30.146032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:30.146480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:30.147119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:30.175814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a800060b-5959-4055-905d-e7ec32cd8f3f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 13 16:17:30.176370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 807/1613] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:30.987242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:30.989352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:30.995232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:30.995707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:30.996139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:30.996811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:30.997254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:30.997673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:31.025627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57a82de7-4fef-49d0-85a9-f8c77249356f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Sep 13 16:17:31.026164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 807/1614] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:31.137820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:31.139997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:31.146677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:31.147208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:31.147652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:31.148343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:31.148779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:31.149235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:31.180490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bde92237-2619-4f50-963b-2a585bd8e2fe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Sep 13 16:17:31.181040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 808/1615] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:31.188217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:31.190571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:31.196847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:31.197323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:31.197765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:31.198448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:31.198916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:31.199345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:31.202861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:31.228817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ece1786f-10cf-45d9-ab68-ed7df99913a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Sep 13 16:17:31.229641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 808/1616] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:32.038039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:32.040210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:32.046310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:32.046790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:32.047256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:32.048462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:32.049082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:32.049516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:32.079323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4da69a0-2b75-449d-aa3a-3b6355b62a57 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Sep 13 16:17:32.079877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 809/1617] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:32.193188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:32.195786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:32.202138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:32.202616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:32.203092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:32.203789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:32.204395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:32.204935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:32.233758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f74e0a9e-02d6-4c31-8498-01610b5b0e04 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Sep 13 16:17:32.234301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 809/1618] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:32.244554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:32.246652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:32.253795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:32.254273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:32.254703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:32.255429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:32.255879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:32.256299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:32.286073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3713ec7-56f5-4acf-806e-97839e2c8026 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Sep 13 16:17:32.286628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 810/1619] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:33.091878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:33.094039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:33.101010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:33.101485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:33.101922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:33.102636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:33.103126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:33.103553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:33.132497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dadec556-462c-4244-8f4d-397f618ca512 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Sep 13 16:17:33.133042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 810/1620] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:33.247618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:33.249721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:33.256793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:33.257202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:33.257648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:33.258210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:33.258653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:33.259307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:33.285026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:33.290431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8deac16-e4d7-43bd-875e-7ba3c0a88910 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046817 Sep 13 16:17:33.295069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 811/1621] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:33.300771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:33.303055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:33.309314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:33.309789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:33.310223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:33.310929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:33.311378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:33.311798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:33.341389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a9b071c-c1c9-47c3-ad05-b11fae100e56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Sep 13 16:17:33.341942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 811/1622] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:34.145420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:34.147501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:34.153364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:34.153836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:34.154269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:34.154968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:34.155414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:34.155833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:34.185619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d442a1dc-c9a2-4a62-b221-b180a7283b84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044706 Sep 13 16:17:34.186154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 812/1623] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:34.302717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:34.304907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:34.311471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:34.311959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:34.312397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:34.313112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:34.313611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:34.314043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:34.344164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ff912b8e-0ece-46d0-a578-98c6eefdd969 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 13 16:17:34.344722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 812/1624] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:34.354299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:34.356493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:34.362985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:34.363466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:34.363905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:34.364591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:34.365042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:34.365467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:34.397996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8203107-76b1-48a2-8cfd-318cbdb13345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Sep 13 16:17:34.397996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 813/1625] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:35.198467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:35.200639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:35.206601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:35.207120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:35.207561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:35.208248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:35.208699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:35.209158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:35.238675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c9a865d-ae0c-4993-a896-e1b35dd70346 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Sep 13 16:17:35.239266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 813/1626] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:35.356771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:35.358918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:35.365995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:35.366479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:35.366933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:35.367630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:35.368085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:35.368723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:35.398511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee3ebe2d-9a62-463d-867e-ef9e117abeec tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Sep 13 16:17:35.399097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 814/1627] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:35.410058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:35.412366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:35.418663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:35.419184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:35.419625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:35.420316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:35.420769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:35.421306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:35.450809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49c8c05f-1d2b-4b56-9842-7bda343ecfba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 Sep 13 16:17:35.451314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 814/1628] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:36.251124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:36.253841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:36.259777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:36.260256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:36.260690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:36.261366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:36.261814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:36.262236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:36.291578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f0b3d79-3e7a-4e6a-8c1d-3d0ac094d247 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Sep 13 16:17:36.292123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 815/1629] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:36.411227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:36.413377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:36.415687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:36.421051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:36.421523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:36.421953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:36.422630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:36.423115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:36.423530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:36.453628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9afa0e9-4e98-4579-aa75-b762f2eda7f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Sep 13 16:17:36.454195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 815/1630] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:36.463611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:36.465762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:36.472224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:36.472972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:36.473412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:36.474114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:36.474569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:36.475030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:36.504719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63912a06-93e6-443b-ba0c-4903fb607756 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Sep 13 16:17:36.505255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 816/1631] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:37.303796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:17:37.305893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:37.311832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:37.312309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:37.312774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:37.313455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:37.313907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:37.314332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:37.384094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dad1a081-b3e9-44ed-907a-191a73d479f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/action" status: 200 len: 41328 microversion: 2.1 time: 0.084085 Sep 13 16:17:37.384718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 816/1632] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:17:37 2022] POST /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd/action => generated 41328 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:17:37.467092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:37.469221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:37.476562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:37.477041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:37.477477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:37.478161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:37.478613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:37.479074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:37.508241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1ddc2ad2-1954-40ee-8048-fc277d59117f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Sep 13 16:17:37.508802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 817/1633] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:37.517788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:37.520710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:37.527634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:37.528118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:37.528549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:37.529272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:37.529859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:37.530295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:37.561553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1853d2f0-5d26-4f25-8370-bba2195f8f39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Sep 13 16:17:37.562023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 817/1634] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:38.521739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:38.523950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:38.530266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:38.530743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:38.531210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:38.531894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:38.532344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:38.532768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:38.561748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4cedacc9-fe4e-44ec-87dd-58524cf88afa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Sep 13 16:17:38.562309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 818/1635] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:38.573570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:38.575772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:38.582747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:38.583333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:38.583785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:38.584470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:38.584918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:38.585335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:38.614771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05ef59b8-2b4f-4978-b16b-7a0ad12497f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Sep 13 16:17:38.615348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 818/1636] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:39.573848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:39.576001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:39.582758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:39.583269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:39.583704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:39.584387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:39.584840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:39.585265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:39.614811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ffbdb4d-be6b-4646-bcea-4914aed39db7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Sep 13 16:17:39.615409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 819/1637] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:39.626871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:39.629090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:39.635657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:39.636141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:39.636579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:39.637268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:39.637718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:39.638141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:39.668330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf2335cc-1c7d-4d83-b1c0-59149fb46a0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Sep 13 16:17:39.668876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 819/1638] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:40.627410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:40.630168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:40.636556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:40.637037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:40.637473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:40.638157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:40.638609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:40.639072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:40.668374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6fab06a7-6965-432a-a546-a973945c938c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Sep 13 16:17:40.668930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 820/1639] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:40.683460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:40.685791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:40.692123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:40.692608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:40.693047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:40.693742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:40.694195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:40.694624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:40.724575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-217ebdc6-938e-4683-bc06-0740c02f27b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Sep 13 16:17:40.725137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 820/1640] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:41.680611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:41.682809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:41.689113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:41.689590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:41.690026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:41.690709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:41.691203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:41.691629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:41.721457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecc206ac-952b-4d90-bc72-683d056365f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Sep 13 16:17:41.722001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 821/1641] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:41.736616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:41.738861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:41.747836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:41.748588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:41.749413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:41.750458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:41.750950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:41.751514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:41.781956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a82aced5-c7a0-4d18-9820-d14146c27fe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049238 Sep 13 16:17:41.782638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 821/1642] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:42.733652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:42.735784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:42.742164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:42.742653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:42.743123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:42.743815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:42.744295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:42.744721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:42.773851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22233575-82e0-43ef-8fb0-9cd18f4b3c36 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Sep 13 16:17:42.774497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 822/1643] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:42.793778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:42.795952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:42.802162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:42.802651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:42.803119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:42.803812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:42.804258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:42.804827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:42.834062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e809e05-f3ca-4ba3-9743-4dd989ff8065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Sep 13 16:17:42.834602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 822/1644] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:43.791423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:43.793632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:43.800293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:43.800848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:43.801370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:43.802175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:43.803227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:43.803677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:43.835689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c994d666-ca64-49eb-a1c3-d7d80ad721bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048856 Sep 13 16:17:43.836240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 823/1645] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:43.845610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:43.847815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:43.856561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:43.857043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:43.857470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:43.858187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:43.858639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:43.859084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:43.889249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-244d851d-9960-4a97-a7bb-dcfc29fb3e89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Sep 13 16:17:43.889797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 823/1646] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:44.848311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:44.850453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:44.856810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:44.857292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:44.857732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:44.858428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:44.858883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:44.859337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:44.891238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9072ada-dfde-47b5-847c-a62b8c2f5164 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Sep 13 16:17:44.891798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 824/1647] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:44.901366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:44.903523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:44.909884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:44.910362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:44.910797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:44.911503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:44.911953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:44.912447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:44.943288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b49ae421-6c91-4efe-b6ed-065f00984822 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Sep 13 16:17:44.944498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 824/1648] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:45.904647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:45.906946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:45.914089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:45.914567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:45.915029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:45.915714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:45.916166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:45.916582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:45.946653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-257537ed-2ebf-402a-abe2-8faca046671f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046115 Sep 13 16:17:45.947225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 825/1649] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:45.956332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:45.958479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:45.965737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:45.966219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:45.966660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:45.967378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:45.967827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:45.968248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:45.970753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:45.999606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-32427166-d761-47f8-b33e-670c57f53caf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047105 Sep 13 16:17:46.000160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 825/1650] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:46.958999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:46.961254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:46.967620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:46.968104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:46.968542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:46.969235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:46.969685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:46.970108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:47.000898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cb5c7a0-5362-4414-a61d-61fce05f6475 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Sep 13 16:17:47.001454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 826/1651] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:47.011274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:47.013405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:47.019737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:47.020222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:47.020663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:47.021349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:47.021808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:47.022234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:47.052785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-828c58e6-e922-4fb5-b2db-465d213c9345 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 13 16:17:47.053340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 826/1652] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:48.013383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:48.015635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:48.021882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:48.022361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:48.022800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:48.023551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:48.024010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:48.024467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:48.053724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39076c7f-3764-43c7-8782-f2acabbcf135 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Sep 13 16:17:48.054947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 827/1653] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:48.064387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:48.066544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:48.073526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:48.074005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:48.074444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:48.075155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:48.075608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:48.076066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:48.106411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1620c02e-9815-4c55-918e-3d5e573ce63c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Sep 13 16:17:48.107016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 827/1654] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:49.065670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:49.067925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:49.074849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:49.075362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:49.075801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:49.076490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:49.076941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:49.077365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:49.094486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:49.108719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb4561b9-59f9-473e-a6e0-b13abc6166ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Sep 13 16:17:49.109267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 828/1655] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:49.118716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:49.120851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:49.127087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:49.127563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:49.127993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:49.128669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:49.129117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:49.129533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:49.159432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5b581fc4-9b58-4cbb-a165-69a9d8aa1452 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Sep 13 16:17:49.164156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 828/1656] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:50.121827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:50.124339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:50.130688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:50.131204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:50.131638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:50.132332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:50.132781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:50.133255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:50.165242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8afb061a-03d2-477d-a669-b585f9b1264d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048389 Sep 13 16:17:50.165790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 829/1657] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:50.171653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:50.173775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:50.180169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:50.180666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:50.181165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:50.181851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:50.182304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:50.182727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:50.212307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-817e5c3c-dac6-4754-b3b3-941f6875ed0d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Sep 13 16:17:50.212974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 829/1658] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:51.177664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:51.180061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:51.187262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:51.187747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:51.188179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:51.188871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:51.189348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:51.189773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:51.219477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e2f89a5-571c-4ed6-8f67-926b08c5d212 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Sep 13 16:17:51.220042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 830/1659] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:51.225106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:51.227859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:51.234753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:51.235278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:51.235718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:51.236412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:51.236870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:51.237301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:51.266968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-959d3edf-16da-44b6-a54e-430e2e522204 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Sep 13 16:17:51.267534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 830/1660] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:52.231766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:52.233919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:52.240326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:52.240810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:52.241249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:52.241939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:52.242391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:52.242812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:52.273639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eef81964-b536-45d1-9ba7-d4ed946688c9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Sep 13 16:17:52.274449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 831/1661] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:52.279513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:52.281709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:52.288199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:52.288679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:52.289114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:52.289797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:52.290258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:52.290685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:52.320280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b593b76a-35e1-499b-a7fe-70fbac52747f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Sep 13 16:17:52.320836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 831/1662] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:53.286023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:53.288199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:53.290809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=72 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:17:53.297589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:53.298076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:53.298521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:53.299253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:53.299714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:53.300144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:53.329787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70b8d1e1-4a05-42dd-9b35-814983c3f87a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Sep 13 16:17:53.333398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 832/1663] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:53.334201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:53.336909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:53.343757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:53.344239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:53.344674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:53.345356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:53.345809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:53.346232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:53.375891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f07f5deb-0701-4417-8d3d-58bd4211753f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Sep 13 16:17:53.376450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 832/1664] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:54.342547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:54.344697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:54.351254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:54.351733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:54.352161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:54.352842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:54.353290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:54.353735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:54.385378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04cca3d7-15b8-4858-93e5-d7f6d1fac8a0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Sep 13 16:17:54.390482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 833/1665] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:54.390823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:54.391273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:54.397382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:54.397862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:54.398316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:54.399112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:54.399564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:54.400137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:54.437035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7eac5002-2561-41f1-8bdd-74037d63f33b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052357 Sep 13 16:17:54.437602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 833/1666] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:55.398193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:55.400345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:55.406838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:55.407344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:55.407778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:55.408541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:55.409015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:55.409457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:55.439037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0944ed6-df32-4a0c-a155-d5ddfb1a5bda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Sep 13 16:17:55.439602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 834/1667] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:55.450050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:55.452280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:55.458675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:55.459196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:55.459632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:55.460321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:55.460772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:55.461195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:55.490259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a75996b-a046-4a56-9b0e-2b72b2c8a9fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Sep 13 16:17:55.490808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 834/1668] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:56.451445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:56.453672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:56.460124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:56.460599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:56.461030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:56.461708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:56.462154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:56.462572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:56.493257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5fa8b60-e16e-48ab-bf27-f6334f36b6df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Sep 13 16:17:56.493815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 835/1669] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:56.503295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:56.505961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:56.513016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:56.513511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:56.513945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:56.514641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:56.515121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:56.515546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:56.545324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac13cba3-7733-4329-8fd0-d9e74bf86c45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 Sep 13 16:17:56.545902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 835/1670] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:17:57.506421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:57.508578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:57.515217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:57.515696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:57.516130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:57.516815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:57.517270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:57.517694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:57.547739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb32e50d-d577-426f-9b09-9b9c3db40aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Sep 13 16:17:57.548302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 836/1671] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:57.556652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:57.558877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:57.565196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:57.565684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:57.566122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:57.566816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:57.567297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:57.567722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:57.597262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fa98146-b305-4de2-b370-e0e571005763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Sep 13 16:17:57.597817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 836/1672] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:58.560749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:58.562890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:58.569195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:58.569671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:58.570101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:58.570780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:58.571311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:58.571742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:58.601801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2798565c-26e1-4dae-bcc8-fb5642eda82c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Sep 13 16:17:58.602363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 837/1673] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:58.610389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:58.612577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:58.618527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:58.619038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:58.619480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:58.620165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:58.620613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:58.621098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:58.650863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f21130a-b12d-48fa-b591-82ef1aa80d91 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045348 Sep 13 16:17:58.651435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 837/1674] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:59.615355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:59.617542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:59.623734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:59.624214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:59.624648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:59.625331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:59.625782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:59.626206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:59.656727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c4a9681-a443-4ee1-bc3f-95d329c56d2f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Sep 13 16:17:59.657529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 838/1675] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:17:59.664414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:17:59.666527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:17:59.673495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:59.674052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:59.674663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:59.675472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:17:59.675997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:17:59.676503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:17:59.706376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ec137079-b38f-44fa-bdf7-77a02a395dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Sep 13 16:17:59.706930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 838/1676] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:17:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:00.669556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:00.671765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:00.678018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:00.678501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:00.678953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:00.679639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:00.680082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:00.680501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:00.709634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f12f694-9ddc-44ec-a725-fdf117071fc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Sep 13 16:18:00.710178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 839/1677] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:00.720164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:00.722479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:00.728505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:00.728991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:00.729431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:00.730145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:00.730577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:00.731024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:00.765116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-de395a6d-b51d-4d64-9e27-8b1878dad0d4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051243 Sep 13 16:18:00.765693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 839/1678] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:01.722719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:01.724834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:01.731245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:01.731729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:01.732170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:01.732862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:01.733588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:01.734017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:01.762691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-090fb618-58fa-48dd-b3f8-3333530a9254 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Sep 13 16:18:01.763814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 840/1679] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:01.777554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:01.780326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:01.786705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:01.787220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:01.787661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:01.788431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:01.788891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:01.789318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:01.818982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b440517e-d264-4d21-a1ea-960eb3dbac1a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 Sep 13 16:18:01.819670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 840/1680] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:02.775523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:02.777629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:02.784831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:02.785303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:02.785735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:02.786417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:02.786864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:02.787311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:02.816296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8efaa219-de48-46b4-8888-e8b64bb8b0bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Sep 13 16:18:02.816835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 841/1681] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:02.831198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:02.833312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:02.839702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:02.840187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:02.840625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:02.841926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:02.842392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:02.842818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:02.868529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:02.873794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1327a782-a615-41ac-81f7-9bc47af9279a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Sep 13 16:18:02.874354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 841/1682] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:03.829503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:03.831633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:03.837847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:03.838319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:03.838746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:03.839450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:03.839894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:03.840312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:03.870265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c70f7ecf-e421-48a6-99d8-aa59311d41c5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045454 Sep 13 16:18:03.870808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 842/1683] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:03.885582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:03.887773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:03.894537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:03.895046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:03.895587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:03.896282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:03.896732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:03.897149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:03.928011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad4f5c68-adf9-4c86-8ae4-f3398081734e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Sep 13 16:18:03.928604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 842/1684] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:04.883529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:04.885647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:04.892579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:04.893061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:04.893499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:04.894191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:04.894643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:04.895102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:04.923929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa7eec0f-c39f-4649-92fd-7687a6912c50 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Sep 13 16:18:04.924504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 843/1685] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:04.940575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:04.942740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:04.949060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:04.949541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:04.949974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:04.950657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:04.951132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:04.951842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:04.980661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4fef05ab-6c89-463a-99e7-15894fc464ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Sep 13 16:18:04.981217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 843/1686] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:05.935852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:05.938652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:05.944975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:05.945452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:05.945882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:05.946564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:05.947034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:05.947461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:05.976252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e9a6e91-6b18-4b7e-bf25-b85c1c616611 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Sep 13 16:18:05.976790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 844/1687] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:05.993620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:05.995843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:06.003297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:06.003776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:06.004213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:06.004892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:06.005340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:06.005763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:06.036460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9416dfb-a454-41cd-a2c6-d65707595674 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Sep 13 16:18:06.037025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 844/1688] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:06.989096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:06.991289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:06.997725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:06.998199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:06.998633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:06.999655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:06.999863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:07.000284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:07.003912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:07.029968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab2f11be-d336-4fab-abfc-8b7ac347f8f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Sep 13 16:18:07.031318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 845/1689] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:18:07.049005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:07.051165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:07.053505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=60 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:07.058753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:07.059261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:07.059698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:07.060386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:07.060837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:07.061262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:07.091439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f855a753-b902-45fa-bb65-4c12ff0d1d6c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Sep 13 16:18:07.092004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 845/1690] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:08.042947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:08.045691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:08.052841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:08.053315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:08.053742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:08.054427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:08.054873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:08.055324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:08.086097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de888ef1-5003-40cd-9c11-11cd2e271feb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047342 Sep 13 16:18:08.086648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 846/1691] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:08.104113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:08.106286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:08.113056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:08.113540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:08.113983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:08.114670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:08.115162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:08.115590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:08.145625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3c78790-2426-4e01-bb1c-b7a45dfb1dd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Sep 13 16:18:08.146185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 846/1692] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:09.097795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:09.100095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:09.106535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:09.107053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:09.107494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:09.108183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:09.108637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:09.109066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:09.138718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0263e72e-6bc5-4107-937d-e8e87834e401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Sep 13 16:18:09.139291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 847/1693] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:09.157527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:09.159776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:09.166100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:09.166581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:09.167051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:09.167739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:09.168187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:09.168610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:09.198486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5d8c068-7b66-4cd8-8542-cd57d4700c21 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Sep 13 16:18:09.199293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 847/1694] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:10.151223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:10.153355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:10.160364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:10.160841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:10.161275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:10.161959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:10.162409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:10.162833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:10.191847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd5977c6-e214-4ee5-be19-bbc9388c5b63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Sep 13 16:18:10.192392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 848/1695] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:10.210923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:10.213126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:10.219117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:10.220344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:10.220790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:10.221468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:10.221914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:10.222343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:10.251474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5852c66d-6d34-4289-b868-b79a3ea02beb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Sep 13 16:18:10.252025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 848/1696] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:11.205042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:11.207146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:11.213509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:11.213992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:11.214453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:11.215162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:11.215618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:11.216046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:11.245012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-623e33f1-beef-4136-a6e8-92ea5656fefc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Sep 13 16:18:11.245556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 849/1697] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:11.263973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:11.266132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:11.273181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:11.273661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:11.274098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:11.274776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:11.275263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:11.275686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:11.304662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2480080-7da9-4562-b9c7-14fb21fdf0e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Sep 13 16:18:11.305218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 849/1698] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:12.257500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:18:12.259710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:12.266198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:12.267219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:12.267662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:12.268357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:12.268814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:12.269248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:12.317069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:12.319158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:12.325509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:12.325987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:12.326422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:12.327131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:12.327588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:12.328011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:12.351518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9383ddd8-7605-4fb2-b4bd-46aadb4add70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/action" status: 200 len: 76288 microversion: 2.1 time: 0.097649 Sep 13 16:18:12.359173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 850/1699] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:18:12 2022] POST /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f/action => generated 76288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:18:12.359344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0948cd4b-5302-4435-bc52-cbafcc60ebae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Sep 13 16:18:12.359344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 850/1700] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:18:13.370737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:13.373006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:13.380323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:13.380796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:13.381225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:13.381905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:13.382350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:13.382769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:13.412994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-23e76bf8-edbd-4c35-9f61-9eaa2b3a6e2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046524 Sep 13 16:18:13.413531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 851/1701] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:14.425759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:14.427926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:14.434196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:14.434672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:14.435139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:14.435823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:14.436274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:14.436707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:14.466548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-709a05cb-40ee-49a6-9918-5354d4e355ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Sep 13 16:18:14.467130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 851/1702] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:15.478196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:15.480357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:15.486694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:15.487205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:15.487643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:15.488329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:15.489112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:15.489545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:15.519586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96421a14-86bf-4dc7-96b1-b331cb5d6a19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Sep 13 16:18:15.520139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 852/1703] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:16.532030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:16.534986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:16.541318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:16.541793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:16.542224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:16.542929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:16.543368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:16.543787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:16.572657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2dbdb97f-b3bb-498c-9020-081073e1b9ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Sep 13 16:18:16.573190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 852/1704] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:17.585130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:17.587559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:17.593983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:17.594458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:17.594891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:17.595597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:17.596045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:17.596471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:17.626032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6cb46fdc-49f4-45df-a4db-65b7ce774d55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Sep 13 16:18:17.626567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 853/1705] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:18.638781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:18.640936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:18.647787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:18.648272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:18.648710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:18.649404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:18.649853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:18.650276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:18.681811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c3dfd0d-6a26-47bc-a3c5-0423622aa751 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046986 Sep 13 16:18:18.682366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 853/1706] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:19.693630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:19.695783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:19.702116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:19.702589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:19.703044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:19.703722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:19.704167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:19.704588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:19.734077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5840348b-82d6-4b6a-addd-eeeac7cdc147 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Sep 13 16:18:19.734618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 854/1707] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:20.746250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:20.748425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:20.755529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:20.756008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:20.756445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:20.757129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:20.757580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:20.758004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:20.787683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e83e522b-13b2-46f8-b516-4bf988a1b024 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Sep 13 16:18:20.788506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 854/1708] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:21.800491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:21.803081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:21.809406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:21.809881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:21.810315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:21.811026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:21.811473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:21.811895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:21.842285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f33e72c-7df4-47d1-8da2-a1c9c0a90de8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Sep 13 16:18:21.842821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 855/1709] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:22.855364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:22.857486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:22.863955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:22.864433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:22.864863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:22.865541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:22.865984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:22.866693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:22.895762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbb93248-5661-47ad-b545-5469049371ef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Sep 13 16:18:22.896609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 855/1710] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:23.908429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:23.910580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:23.913045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=48 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:23.918188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:23.918660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:23.919129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:23.919812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:23.920258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:23.920675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:23.949562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b9ccdb5-b650-49d1-9da1-df476bc36845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Sep 13 16:18:23.950106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 856/1711] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:24.962408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:24.964568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:24.970945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:24.971434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:24.971871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:24.972554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:24.973004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:24.973427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:25.002670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7cf088a1-d951-45e5-8f27-29336d9aef1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Sep 13 16:18:25.003239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 856/1712] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:26.015127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:26.017326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:26.024358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:26.024837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:26.025273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:26.025956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:26.026407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:26.026834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:26.056096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28ab9ec4-2a44-443f-9376-be5a2b2ef8c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Sep 13 16:18:26.056641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 857/1713] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:27.068385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:27.070689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:27.077105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:27.077586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:27.078020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:27.078784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:27.079311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:27.079740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:27.108943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-15345af8-90e0-4c7b-8ff8-8436e3559fde tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Sep 13 16:18:27.109481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 857/1714] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:28.123729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:28.125843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:28.132834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:28.133305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:28.133739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:28.134413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:28.134857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:28.135300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:28.163450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-043307d3-a793-40d2-9ba5-caf9f28840ec tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Sep 13 16:18:28.164000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 858/1715] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:29.175868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:29.178039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:29.184478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:29.184957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:29.185388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:29.186065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:29.186509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:29.186945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:29.200647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:29.216986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1225275b-fb0d-4d21-a2a3-b8e78c572736 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Sep 13 16:18:29.217584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 858/1716] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:18:30.229658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:30.231830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:30.238171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:30.238650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:30.239140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:30.239816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:30.240267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:30.240722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:30.270694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abe88cb9-8297-4bf8-8138-0a6af0a218e7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Sep 13 16:18:30.271275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 859/1717] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:31.283747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:31.285874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:31.292795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:31.293276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:31.293716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:31.294403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:31.294855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:31.295302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:31.324268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-319bc497-ec51-44d7-a7f5-18603ce8b3d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Sep 13 16:18:31.324812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 859/1718] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:32.337333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:32.339475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:32.345802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:32.346271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:32.346699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:32.347406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:32.347853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:32.348274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:32.377647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-913f9d4e-9b8d-488d-8b02-d27d3ff20508 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Sep 13 16:18:32.378193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 860/1719] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:33.390181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:33.392340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:33.398649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:33.399153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:33.400281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:33.400978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:33.401428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:33.401853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:33.430954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-27d02afe-cd6d-4617-a1c9-54aca1909095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Sep 13 16:18:33.431488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 860/1720] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:34.443336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:34.445533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:34.452068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:34.452548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:34.452985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:34.453684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:34.454118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:34.454543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:34.484362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3cde68c1-c554-4938-8696-2ad5e46e89c3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Sep 13 16:18:34.484920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 861/1721] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:35.496268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:35.498414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:35.504825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:35.505314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:35.505755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:35.506446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:35.506930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:35.507357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:35.537501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-06a46f59-53e5-4956-8a6e-3e8fd8f82f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Sep 13 16:18:35.538050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 861/1722] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:36.550690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:36.552824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:36.560089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:36.560562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:36.560991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:36.561669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:36.562115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:36.562534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:36.566117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:36.591160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-291f00c1-cbc0-4ed2-bd8f-065310507d57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Sep 13 16:18:36.591692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 862/1723] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:37.602588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:37.604940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:37.607422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=34 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:37.612747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:37.613227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:37.613665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:37.614356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:37.614808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:37.615254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:37.644961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0869e410-6fa8-49f3-bbbf-d11513714944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046277 Sep 13 16:18:37.645504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 862/1724] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:38.658176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:38.660337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:38.666667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:38.667167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:38.668277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:38.668952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:38.669402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:38.669823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:38.697881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a51a18c-efa2-46d1-8885-9995a5199ca6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Sep 13 16:18:38.698412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 863/1725] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:39.710463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:39.712607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:39.718593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:39.719113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:39.719551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:39.720238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:39.720691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:39.721116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:39.751305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21f7fba8-b041-4c79-8fce-6f4820052c97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Sep 13 16:18:39.752058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 863/1726] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:40.763729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:40.765842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:40.772132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:40.772604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:40.773037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:40.773715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:40.774160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:40.774579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:40.803970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddb4c389-9269-4478-91a6-f5e8755d0daa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Sep 13 16:18:40.804520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 864/1727] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:41.817379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:41.819536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:41.825772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:41.826292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:41.826925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:41.827596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:41.828043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:41.828463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:41.856893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac44951a-48ce-45af-b5df-43f3164325bc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Sep 13 16:18:41.858190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 864/1728] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:42.869659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:42.871840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:42.878483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:42.878993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:42.879441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:42.880132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:42.880612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:42.881036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:42.910558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11fccf4a-e1b4-4ae3-9813-0c494c9397f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Sep 13 16:18:42.911149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 865/1729] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:43.923554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:43.925694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:43.932006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:43.932482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:43.932912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:43.933592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:43.934040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:43.934461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:43.962940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4217371a-880f-40b9-a4aa-a5cff6eeabfa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Sep 13 16:18:43.963478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 865/1730] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:44.976967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:44.979134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:44.986129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:44.986640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:44.987104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:44.987797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:44.988241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:44.988666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:45.019906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce61ac2a-5427-473b-a96e-079afa7cb941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Sep 13 16:18:45.020538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 866/1731] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:46.035387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:46.037537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:46.039988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:18:46.040185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:18:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:18:46.045359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:46.045852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:46.046361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:46.047272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:46.047725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:46.048155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:46.081069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f80d08be-f8f6-4e6f-864f-fdc474c3f4f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049787 Sep 13 16:18:46.081630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 866/1732] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:47.094214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:47.096373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:47.102719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:47.103238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:47.103675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:47.104362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:47.104813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:47.105239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:47.133837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c39380a-e664-4a3d-be42-2371c0773b61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Sep 13 16:18:47.134379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 867/1733] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:48.146805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:48.148893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:48.155292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:48.155771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:48.156211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:48.156899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:48.157337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:48.157758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:48.185886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a10a60d-c1eb-4bde-99d8-9404f30f1ba1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Sep 13 16:18:48.186422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 867/1734] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:49.198542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:49.200708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:49.207649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:49.208060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:49.208493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:49.209171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:49.209617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:49.210037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:49.238508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62fd3efd-7a9f-4a2d-9170-6dde9fc6bb50 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Sep 13 16:18:49.239062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 868/1735] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:50.252189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:50.254295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:50.260762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:50.261236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:50.261668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:50.262349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:50.262795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:50.263243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:50.294087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba7330fc-abce-415c-b705-5a24ac999e1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046597 Sep 13 16:18:50.294854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 868/1736] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:51.307334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:51.309508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:51.316833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:51.317248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:51.317678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:51.318355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:51.318801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:51.319248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:51.348356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-229ff213-8bec-4ba9-a2c5-acb6375e1bc1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Sep 13 16:18:51.348895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 869/1737] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:18:52.360665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:52.363417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:52.365850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:18:52.365996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:18:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:18:52.371923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:52.372398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:52.372829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:52.373511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:52.373959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:52.374378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:52.404703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7491a01f-4cbf-42ea-88c0-ca0793ee288b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047959 Sep 13 16:18:52.405243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 869/1738] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:53.417208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:53.419465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:53.425938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:53.426413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:53.426849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:53.427566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:53.428024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:53.428446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:53.458032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b7ca3c6-5584-4458-aca7-57e6c95435cf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 13 16:18:53.458575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 870/1739] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:54.470500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:54.472704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:54.479034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:54.479625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:54.480070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:54.480759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:54.481210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:54.481634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:54.511008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e40dab15-c45c-4641-b659-fb4764f689f9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Sep 13 16:18:54.511556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 870/1740] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:55.523576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:55.525712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:55.528023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:18:55.533271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:55.533751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:55.534227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:55.534875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:55.535352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:55.535780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:55.564643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-267f483d-bbcc-44ec-86a7-157dc3df0a45 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Sep 13 16:18:55.565963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 871/1741] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:56.577745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:56.579878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:56.586307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:56.586784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:56.587245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:56.587925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:56.588375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:56.588794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:56.618093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b39bab7-81c9-44f4-b2c6-b098be099873 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Sep 13 16:18:56.618651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 871/1742] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:57.630071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:57.632250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:57.638495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:57.639002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:57.639436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:57.640119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:57.640566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:57.640984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:57.670309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55c1e426-7971-4f1c-ae52-6b3ec6725515 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Sep 13 16:18:57.670841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 872/1743] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:58.682629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:58.684782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:58.691757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:58.692237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:58.692668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:58.693377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:58.693831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:58.694251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:58.723957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-caa92811-4adf-47fa-bf3f-4d31b5953b97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Sep 13 16:18:58.724502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 872/1744] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:18:59.736466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:18:59.739205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:18:59.741166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:18:59.741307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:18:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:18:59.747304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:59.747778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:59.748203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:59.748888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:18:59.749334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:18:59.749756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:18:59.780586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d2176a9-d596-4256-abf6-3b8021dafba8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048242 Sep 13 16:18:59.781140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 873/1745] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:18:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:00.793172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:00.795378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:00.802294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:00.802776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:00.803244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:00.803931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:00.804400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:00.804805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:00.808334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:00.836471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28725d12-1e71-48cd-919d-184336629200 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Sep 13 16:19:00.837028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 873/1746] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:01.849390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:01.851559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:01.857908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:01.858387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:01.858821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:01.859532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:01.859980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:01.860401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:01.890239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-128583fd-1397-4a5e-b981-b1a7f15b27d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045303 Sep 13 16:19:01.890778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 874/1747] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:02.902169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:02.904354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:02.910857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:02.911768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:02.912197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:02.912873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:02.913320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:02.913740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:02.943885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7dc54f79-f4be-4f1c-8fec-e9503c96320e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Sep 13 16:19:02.944422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 874/1748] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:03.956240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:03.958503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:03.964816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:03.965290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:03.965729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:03.966409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:03.966856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:03.967417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:03.997098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3596c8f0-dcda-439d-a54e-c524566606e9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Sep 13 16:19:03.997639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 875/1749] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:05.009654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:05.011808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:05.018113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:05.018594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:05.019069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:05.019752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:05.020203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:05.021236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:05.050776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-062b899b-9843-49c7-8c7e-3a3234f5f46a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Sep 13 16:19:05.051365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 875/1750] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:06.063263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:06.065426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:06.072533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:06.073013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:06.073449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:06.074137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:06.074589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:06.075058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:06.104108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c764640-5bd4-450a-9670-568353150b34 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Sep 13 16:19:06.104655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 876/1751] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:07.115843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:07.118096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:07.124626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:07.125140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:07.125570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:07.126249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:07.126694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:07.127153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:07.156399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1f3fbfde-941f-4409-8ec1-d06ba970dcb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Sep 13 16:19:07.156944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 876/1752] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:08.168999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:08.171163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:08.177519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:08.177999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:08.178439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:08.179164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:08.179617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:08.180040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:08.184314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=89 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:08.210420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a698ef0-75ba-4e77-b380-ddaf9cd2cab9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Sep 13 16:19:08.210994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 877/1753] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:09.222983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:09.225052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:09.227464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:09.233121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:09.233597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:09.234032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:09.234713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:09.235187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:09.235613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:09.264962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-105858d1-915e-4ea4-a8b2-f1a54620efe8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Sep 13 16:19:09.265512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 877/1754] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:10.277997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:10.280165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:10.286814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:10.287329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:10.287769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:10.288461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:10.289213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:10.289421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:10.320493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ffcbbaf0-1aed-4217-b533-59398e91706d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047013 Sep 13 16:19:10.320970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 878/1755] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:11.332971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:11.335146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:11.341829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:11.342310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:11.342746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:11.343457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:11.343912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:11.344343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:11.373870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2574658-73da-4f00-b12f-7e61fe1bcfbb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Sep 13 16:19:11.374422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 878/1756] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:12.387024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:12.389173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:12.395698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:12.396180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:12.396618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:12.397403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:12.397763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:12.398280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:12.428750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b01a6424-c31f-490d-9afc-50f32822cfbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045962 Sep 13 16:19:12.429298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 879/1757] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:13.441277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:13.443456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:13.450887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:13.451403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:13.451838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:13.452531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:13.452982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:13.453408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:13.483002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-247a06d4-4909-4640-acfc-c07a269c0e25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Sep 13 16:19:13.483565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 879/1758] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:14.495442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:14.497598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:14.503944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:14.504420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:14.504852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:14.505530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:14.505974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:14.506393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:14.536620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25e00869-6866-4152-b288-f57bd3676427 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Sep 13 16:19:14.537194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 880/1759] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:15.549200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:15.551336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:15.557594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:15.558073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:15.558497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:15.559197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:15.559641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:15.560058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:15.588488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3cc9301-3035-493e-8bf2-aa8b9ffcb378 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043301 Sep 13 16:19:15.589543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 880/1760] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:16.601338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:16.603560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:16.610372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:16.610880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:16.611340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:16.612049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:16.612507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:16.612961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:16.642385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39a5bee1-f501-43ef-8589-b018dedf02d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Sep 13 16:19:16.642952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 881/1761] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:17.655658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:17.657844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:17.664172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:17.664656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:17.665092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:17.665774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:17.666231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:17.666654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:17.695511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1488a97b-f1d0-456c-b57a-f574495290b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044508 Sep 13 16:19:17.696050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 881/1762] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:18.708197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:18.710403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:18.717315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:18.717800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:18.718234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:18.718944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:18.719402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:18.719825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:18.749379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e605873-0c79-476c-9c2d-3ce742e08ba3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Sep 13 16:19:18.749916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 882/1763] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:19:19.762825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:19.764961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:19.771446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:19.771925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:19.772370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:19.773058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:19.773514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:19.773942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:19.802822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d9e3ba0-e416-4cb4-8885-62217621af97 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Sep 13 16:19:19.803408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 882/1764] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:20.815448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:20.817597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:20.824015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:20.826011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:20.826530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:20.827310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:20.827794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:20.828227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:20.858716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd6f572d-890f-46ba-9108-6867b0411b68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047289 Sep 13 16:19:20.859294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 883/1765] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:21.871369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:21.874306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:21.880723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:21.881199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:21.881631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:21.882308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:21.882754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:21.883199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:21.911991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc6443f3-429e-45a2-b82a-3ccf1053bb56 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Sep 13 16:19:21.912713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 883/1766] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:22.924555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:22.926708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:22.932984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:22.933457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:22.933891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:22.935357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:22.935547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:22.935965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:22.964718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-116b70cc-41d1-4d5d-b0fa-608d0d22746b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Sep 13 16:19:22.965255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 884/1767] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:23.977206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:23.979370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:23.986960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:23.987469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:23.987906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:23.988589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:23.989037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:23.989457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:24.018499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-77603c4a-5dbf-4a3d-ab50-8936cdf8b281 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045225 Sep 13 16:19:24.019064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 884/1768] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:25.031052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:25.033211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:25.039585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:25.040070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:25.040507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:25.041196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:25.041654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:25.042082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:25.071731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80a0e528-daa2-4fa7-b9ef-3efbbc8ef699 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 13 16:19:25.072297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 885/1769] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:26.084829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:26.087027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:26.093964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:26.094448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:26.094890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:26.095608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:26.096063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:26.096491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:26.126260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-896e5732-c912-4da0-b882-08d934e56c39 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045394 Sep 13 16:19:26.126813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 885/1770] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:27.139174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:27.141371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:27.143651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:27.148756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:27.149237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:27.149672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:27.150386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:27.150844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:27.151293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:27.180640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-006d3127-e31e-43cf-8b7c-44ffba00c56a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Sep 13 16:19:27.181187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 886/1771] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:28.193047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:28.195211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:28.202290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:28.202768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:28.203228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:28.203909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:28.204359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:28.204785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:28.233428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1113660a-f152-447b-995d-4a8ae5874bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Sep 13 16:19:28.233975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 886/1772] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:29.245622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:29.247796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:29.254195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:29.254683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:29.255152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:29.255849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:29.256304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:29.256764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:29.286724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61f84d3d-7fbc-4f87-a5c4-6f0c042ad76c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Sep 13 16:19:29.287300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 887/1773] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:30.300160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:30.302411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:30.309092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:30.309565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:30.310007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:30.310711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:30.311208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:30.312211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:30.341225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c868094-9946-431d-b778-2baf3fc6a2fb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Sep 13 16:19:30.341773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 887/1774] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:31.353809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:31.355993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:31.362568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:31.363092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:31.363537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:31.364221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:31.364677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:31.365104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:31.395380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c391bccb-6998-46bf-b15c-62fddd5e96de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Sep 13 16:19:31.395924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 888/1775] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:32.407780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:32.409970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:32.416589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:32.417070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:32.417500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:32.418184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:32.418632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:32.419086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:32.423171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:32.448897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffa0f13b-97fb-471c-a296-fe32dd8cb4e6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Sep 13 16:19:32.449444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 888/1776] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:33.460779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:33.462942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:33.469282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:33.469758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:33.470190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:33.470874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:33.471347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:33.471773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:33.500419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4ac0f15-05c8-45ea-8787-d6a0afa698b4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042917 Sep 13 16:19:33.500966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 889/1777] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:34.513010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:34.516114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:34.522513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:34.523024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:34.523464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:34.524145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:34.524598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:34.525024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:34.554395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c99d3d7-d3d7-4126-ac57-3990246c7227 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Sep 13 16:19:34.554967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 889/1778] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:35.567618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:35.569700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:35.576087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:35.576573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:35.577013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:35.577709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:35.578236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:35.578770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:35.607234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3e9ee90-997c-4d22-84f4-56823b678d2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Sep 13 16:19:35.607774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 890/1779] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:36.619211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:36.621379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:36.627951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:36.628430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:36.628868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:36.629548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:36.630026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:36.630454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:36.659723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c4f5e23-6762-452b-8b90-265a9c180a35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Sep 13 16:19:36.660265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 890/1780] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:37.671971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:37.674646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:37.680935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:37.681407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:37.681837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:37.682511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:37.682988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:37.683407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:37.712148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07bebfaf-cdce-4d26-806d-9ba808c30145 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Sep 13 16:19:37.712718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 891/1781] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:38.724565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:38.726726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:38.733330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:38.733844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:38.734281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:38.735000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:38.735619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:38.736084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:38.767395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d6367459-0960-42c8-ba52-36da14c44187 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Sep 13 16:19:38.767959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 891/1782] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:39.779166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:39.781347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:39.788289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:39.788762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:39.789202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:39.789870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:39.790347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:39.790769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:39.794255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:39.820200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40b56520-8af9-4282-a7c2-323892259264 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Sep 13 16:19:39.820740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 892/1783] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:40.833338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:40.836492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:40.841602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:40.844104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:40.844632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:40.846119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:40.847314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:40.848266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:40.848266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:40.879637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c718f1b-1e0b-4c9c-942e-d8aed80576c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050891 Sep 13 16:19:40.880189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 892/1784] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:41.892684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:41.895441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:41.901849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:41.902322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:41.902756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:41.903459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:41.903904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:41.904322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:41.934402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a424acdc-3ec2-4d2f-8660-e192ab96c1a3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046132 Sep 13 16:19:41.934972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 893/1785] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:42.947017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:42.949176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:42.956250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:42.956724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:42.957152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:42.957832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:42.958276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:42.958696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:42.987732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0fe261f9-7c1b-42c1-8eeb-33446e60b57c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Sep 13 16:19:42.988278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 893/1786] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:43.999886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:44.001995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:44.008335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:44.008816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:44.009254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:44.009948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:44.010403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:44.010832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:44.040365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b24a634c-11d5-44d2-8e17-9186bc484fd9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Sep 13 16:19:44.040925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 894/1787] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:45.053261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:45.055418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:45.061782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:45.062265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:45.062703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:45.063424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:45.064296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:45.064296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:45.093699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6e92a890-ed92-499b-ac7a-46c10256b4d7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Sep 13 16:19:45.094253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 894/1788] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:46.106161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:46.108326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:46.114731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:46.115247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:46.115680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:46.116368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:46.116818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:46.117243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:46.147501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1c34321-e0d2-42ff-805b-20d0b118f371 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Sep 13 16:19:46.148049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 895/1789] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:47.160675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:47.163056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:47.169582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:47.170069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:47.170512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:47.171241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:47.171702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:47.172132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:47.203294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-056c5203-3da1-4e04-ac09-0d8db6d9a7eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Sep 13 16:19:47.203862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 895/1790] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:48.215127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:48.217329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:48.223823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:48.224299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:48.224730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:48.225404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:48.225880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:48.226299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:48.255602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-866ee9de-727b-44d0-bcfe-dbd25b515066 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Sep 13 16:19:48.256142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 896/1791] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:49.268050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:49.271262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:49.278925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:49.279395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:49.279913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:49.280950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:49.281406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:49.281829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:49.310678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87704931-8e0f-48e9-90bd-8ac8edb5a3ca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Sep 13 16:19:49.311250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 896/1792] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:50.323352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:50.325497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:50.331820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:50.332295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:50.332722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:50.333399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:50.333844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:50.334264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:50.363673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce0c9fcc-cf00-42bc-8c92-c4dca9dacbeb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Sep 13 16:19:50.364029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 897/1793] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:51.375389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:51.377567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:51.384819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:51.385298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:51.385731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:51.386413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:51.386862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:51.387311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:51.419232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37de389f-980a-499c-9b75-6f30f487f3af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Sep 13 16:19:51.419799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 897/1794] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:52.431649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:52.433789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:52.440275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:52.440759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:52.441199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:52.442709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:52.443199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:52.443630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:52.472710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d0719b7-b097-48dd-98b5-0d331f8d9858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Sep 13 16:19:52.473254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 898/1795] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:53.484772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:53.486870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:53.493315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:53.493795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:53.494229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:53.494922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:53.495382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:53.495805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:53.524815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ddcb91e-6bce-4376-8e2f-5c9ba4cdd2bb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Sep 13 16:19:53.525360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 898/1796] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:54.538109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:54.540186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:54.546635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:54.547143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:54.547578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:54.548259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:54.548705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:54.549131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:54.578730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4182019-33e5-4799-aed0-66915732085a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Sep 13 16:19:54.579300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 899/1797] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:55.591446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:55.593630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:55.600674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:55.601147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:55.601575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:55.602251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:55.602697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:55.603144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:55.631187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0cd8105f-4ba8-4135-b07e-d369d47081e4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Sep 13 16:19:55.631731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 899/1798] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:56.643559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:56.646585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:56.652955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:56.653438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:56.653880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:56.654577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:56.655059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:56.655492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:56.684130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36c9205c-1e0c-4d31-87a3-43bc5bd1096b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Sep 13 16:19:56.684673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 900/1799] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:57.696794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:57.698838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:57.705241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:57.705717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:57.706147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:57.706828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:57.707339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:57.707762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:57.736334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b366ca1-b3b9-4c57-8b16-22bee53e1ac4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Sep 13 16:19:57.736874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 900/1800] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:58.749478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:58.751564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:58.753859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:19:58.760141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:58.760623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:58.761053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:58.761736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:58.762183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:58.762604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:58.791749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a8e128a-3229-482c-947d-e4a8691c69d9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046350 Sep 13 16:19:58.792307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 901/1801] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:59.804142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:59.806312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:19:59.812653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:59.813136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:59.813574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:59.814260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:59.814713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:59.815170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:59.844627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1daf40e6-cb19-490b-b61f-dd4256281d1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Sep 13 16:19:59.845176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 901/1802] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:19:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:20:00.857126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:00.859388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:00.866758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:00.867177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:00.867665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:00.868383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:00.868937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:00.869478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:00.900476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6bb82ca8-eaf5-4be6-9c9f-2875a143828d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Sep 13 16:20:00.901038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 902/1803] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:01.919163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:01.921315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:01.927788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:01.928452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:01.928888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:01.929579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:01.930032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:01.930457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:01.959900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59d078a4-37d9-4cf3-89fe-093d7dfdb0cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Sep 13 16:20:01.960444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 902/1804] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:02.972610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:02.974659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:02.981606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:02.982084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:02.982519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:02.983239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:02.983693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:02.984117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:03.013545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4730571d-f3bb-44fd-9315-1274cfa203ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045061 Sep 13 16:20:03.014091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 903/1805] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:04.025757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:04.027879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:04.034307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:04.034786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:04.035260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:04.035948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:04.036403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:04.036830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:04.039232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:04.067465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-591ef3d2-a25f-49b6-abeb-17c466c08c4d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Sep 13 16:20:04.068016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 903/1806] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:05.080716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:05.082874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:05.090142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:05.090620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:05.091089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:05.091780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:05.092229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:05.092655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:05.121510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97478fd6-e249-4f49-a724-b01a4d1d0841 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Sep 13 16:20:05.122052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 904/1807] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:06.133618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:06.135715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:06.142113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:06.142594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:06.143061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:06.143744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:06.144195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:06.144620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:06.173950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6fbf6e8-e2d5-4707-bebe-e12e0a6b0b63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Sep 13 16:20:06.174496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 904/1808] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:07.186530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:07.188868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:07.195596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:07.196102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:07.196537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:07.197223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:07.197671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:07.198091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:07.227089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c4656c3-c5d9-47d0-a251-a2cede747e5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Sep 13 16:20:07.227624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 905/1809] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:08.238551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:08.240682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:08.247709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:08.248182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:08.248618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:08.249302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:08.249754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:08.250177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:08.279324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d10b59de-1082-48da-8f04-fb923b70ffc7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Sep 13 16:20:08.279867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 905/1810] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:09.291723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:09.293822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:09.300208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:09.300690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:09.301126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:09.301814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:09.302264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:09.302688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:09.332421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03cf634c-e393-4902-8165-0434537dd01d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Sep 13 16:20:09.332968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 906/1811] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:10.344858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:10.347071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:10.353159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:10.353644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:10.354084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:10.354770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:10.355259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:10.355696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:10.385213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93d7e27d-3601-4cca-afca-e39da19ac4e0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Sep 13 16:20:10.385761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 906/1812] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:11.397626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:11.400587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:11.406998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:11.407476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:11.407909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:11.408589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:11.409039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:11.409466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:11.411805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:11.439100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83ed2f1d-2bdd-4ceb-ad19-4c00f917368b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Sep 13 16:20:11.439649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 907/1813] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:12.451540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:12.453585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:12.455927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:12.461367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:12.461921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:12.462374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:12.463082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:12.463532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:12.463958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:12.492797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-04927395-b96e-438c-b759-4f4665912466 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Sep 13 16:20:12.494045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 907/1814] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:13.505887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:13.508050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:13.515313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:13.515801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:13.516240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:13.516934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:13.517389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:13.517819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:13.547794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e26da298-45c6-4edb-99a2-940d3de0b195 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045930 Sep 13 16:20:13.548638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 908/1815] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:14.561108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:14.563188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:14.569558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:14.570037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:14.570476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:14.571261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:14.572378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:14.572809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:14.601092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30139057-b47f-4996-889f-764f35c130db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Sep 13 16:20:14.601630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 908/1816] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:15.612676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:15.614820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:15.621407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:15.621889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:15.622329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:15.623052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:15.623508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:15.623942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:15.654633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76c344e1-eb50-44f0-83c4-7e905b53a49e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Sep 13 16:20:15.655218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 909/1817] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:16.668283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:16.670452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:16.676853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:16.677342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:16.677783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:16.678476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:16.678959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:16.679392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:16.709135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e302fed-0038-47f4-83bc-b5882a7f48f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Sep 13 16:20:16.709615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 909/1818] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:17.721988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:17.724164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:17.730553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:17.731070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:17.731505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:17.732193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:17.732646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:17.733073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:17.761875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f451404-2907-450f-896e-32008f69b853 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Sep 13 16:20:17.762433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 910/1819] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:18.774080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:18.777195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:18.783568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:18.784050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:18.784483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:18.785167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:18.785617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:18.786040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:18.815295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5701c33-594d-479d-a946-4b5bd64bc895 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Sep 13 16:20:18.815846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 910/1820] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:19.827736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:19.829962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:19.836319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:19.836800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:19.837240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:19.837930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:19.838891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:19.839338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:19.868489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2ae961b-16db-4494-bc8a-2c67114ff10d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Sep 13 16:20:19.869031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 911/1821] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:20.880385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:20.882570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:20.889161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:20.889648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:20.890091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:20.890793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:20.891284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:20.891748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:20.921681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37361566-548f-4376-99f5-409f931cdcbc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Sep 13 16:20:20.922388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 911/1822] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:21.933780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:21.935939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:21.942230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:21.942709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:21.943186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:21.943874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:21.944333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:21.944757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:21.973521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad20fe94-7a5d-4e95-bd54-83d6d97cae41 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Sep 13 16:20:21.974075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 912/1823] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:22.985702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:22.987906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:22.994200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:22.994679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:22.995155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:22.995892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:22.996343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:22.996768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:23.025841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1aff381-15b5-4aa4-8a6e-3d84ccd7bac8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Sep 13 16:20:23.026395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 912/1824] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:24.038835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:24.040996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:24.048131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:24.048609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:24.049044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:24.049726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:24.050171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:24.050593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:24.079530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60e02c78-8ac6-40a4-90b6-7d1db6a69365 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Sep 13 16:20:24.080069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 913/1825] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:25.092456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:25.094575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:25.100994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:25.101465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:25.101891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:25.102564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:25.103047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:25.103466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:25.134467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab933689-8775-4eb9-beb0-9074b5668738 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046576 Sep 13 16:20:25.135041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 913/1826] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:26.147318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:26.149452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:26.156645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:26.157120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:26.157555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:26.158240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:26.158693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:26.159144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:26.187541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9132fd69-91f7-42d8-87d7-3ea0e03c605f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Sep 13 16:20:26.188083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 914/1827] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:27.199754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:27.202789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:27.209807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:27.210283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:27.210718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:27.211432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:27.211924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:27.212342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:27.241915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37a37809-86ef-4da4-9f67-ef9db538bc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Sep 13 16:20:27.242457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 914/1828] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:28.253613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:28.255961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:28.262276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:28.262763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:28.263239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:28.263936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:28.264427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:28.264856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:28.294264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee75c1c1-6b12-49be-85bd-bdb55d8a2654 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Sep 13 16:20:28.294806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 915/1829] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:29.305502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:29.307668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:29.314092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:29.314576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:29.315049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:29.315740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:29.316194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:29.316622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:29.345992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db8a6705-8f19-4c92-9146-2bcc933ebb9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Sep 13 16:20:29.346547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 915/1830] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:30.358621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:30.360901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:30.363036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:30.368531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:30.369189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:30.369619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:30.370301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:30.370750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:30.371197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:30.400563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-672b55ab-1447-4efe-89de-38a647099455 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Sep 13 16:20:30.401311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 916/1831] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:31.414272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:31.420142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:31.427745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:31.428224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:31.428653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:31.429338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:31.429780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:31.430198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:31.459951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b4dc0a58-2ac0-4549-9880-1117b040c96c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050113 Sep 13 16:20:31.460489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 916/1832] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:32.472302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:32.474437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:32.476424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:20:32.476591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:20:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:20:32.483721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:32.484199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:32.484628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:32.485316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:32.485763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:32.486180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:32.516509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e11518e0-0de4-471b-a213-9d9dd0076f2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Sep 13 16:20:32.517049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 917/1833] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:33.528358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:33.530798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:33.537487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:33.537970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:33.538408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:33.539135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:33.539592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:33.540020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:33.570149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01c5e3cb-8376-437f-94f4-70966c2a64af tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Sep 13 16:20:33.570690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 917/1834] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:34.582973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:34.585169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:34.591740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:34.592219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:34.592653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:34.593338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:34.593789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:34.594213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:34.622417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-549b8f04-17e6-4ba7-a47f-5bb4affd2ff6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043347 Sep 13 16:20:34.623608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 918/1835] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:35.634952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:35.637207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:35.644558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:35.645042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:35.645477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:35.646171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:35.646619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:35.647084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:35.650710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:35.677014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a53e14c0-28a2-4231-9bc5-147176cc205f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Sep 13 16:20:35.677562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 918/1836] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:36.688835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:36.691017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:36.697043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:36.697510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:36.697935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:36.698644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:36.699076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:36.699496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:36.729343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a3ae699-01a8-4615-abcf-5897293e2e53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Sep 13 16:20:36.729876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 919/1837] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:37.742475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:37.745020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:37.751879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:37.752365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:37.752792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:37.753477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:37.753923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:37.754342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:37.785649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-294eb292-9305-46dd-bc3c-f429f538c68c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Sep 13 16:20:37.786200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 919/1838] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:38.797468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:38.799668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:38.805733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:38.806216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:38.806657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:38.807385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:38.807843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:38.808267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:38.838534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a4847fb-09e5-4963-a158-654eb7d3e67f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Sep 13 16:20:38.839115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 920/1839] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:39.851369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:39.853474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:39.860353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:39.860828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:39.861263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:39.862014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:39.862377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:39.862794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:39.891896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe496b6f-049b-4ac7-9fd2-b41b0c9c74f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Sep 13 16:20:39.892448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 920/1840] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:40.907286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:40.909651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:40.916211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:40.916690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:40.917119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:40.917809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:40.918253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:40.918671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:40.949024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c33439a-3718-4286-aaeb-b6b34f2ef81c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048351 Sep 13 16:20:40.949569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 921/1841] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:41.962593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:41.964758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:41.970827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:41.971330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:41.971760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:41.972447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:41.972891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:41.973463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:42.003608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-934a66be-c7a1-42ab-8b32-f7c0edbb24c4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Sep 13 16:20:42.004166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 921/1842] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:43.016740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:43.019179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:43.025753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:43.026238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:43.026672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:43.027405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:43.027858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:43.028285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:43.032528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:43.060456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d8fbdff-70e0-441b-9288-ba41cb0b47d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048372 Sep 13 16:20:43.061007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 922/1843] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:44.073038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:44.075248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:44.079369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:20:44.083464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:44.083951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:44.084386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:44.085081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:44.085529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:44.085953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:44.116390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-603bf0fe-76f3-4746-8583-7a19abc3472a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047087 Sep 13 16:20:44.116948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 922/1844] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:45.130318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:45.132426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:45.141205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:45.141694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:45.142132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:45.142830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:45.143325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:45.143755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:45.174662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ddabe66-d115-42ee-b19c-627a4f4eda77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050669 Sep 13 16:20:45.175279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 923/1845] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:46.187703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:46.189986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:46.196134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:46.196622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:46.197060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:46.197759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:46.198242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:46.198671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:46.229178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3f04e1b-a5a6-4a24-ad88-b31ed0a75a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 Sep 13 16:20:46.229738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 923/1846] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:47.241776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:47.244111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:47.251386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:47.251860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:47.252289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:47.252997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:47.253472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:47.253898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:47.283962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0a7ac22-4dd3-4609-b2ba-5ffcd9b0522b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Sep 13 16:20:47.286381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 924/1847] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:48.296215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:48.298324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:48.305609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:48.306257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:48.306879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:48.307936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:48.308334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:48.308984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:48.341739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-819db63e-0b63-4c82-9f2c-7413c9e69f61 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049375 Sep 13 16:20:48.342298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 924/1848] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:49.355066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:49.357237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:49.370944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:49.371475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:49.371916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:49.372624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:49.373077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:49.373506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:49.415990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-235f70c5-ad7f-4af7-a5d6-a1fbef9de1d8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065132 Sep 13 16:20:49.416576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 925/1849] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:50.429331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:50.431552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:50.437891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:50.438454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:50.439122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:50.439833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:50.440291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:50.440719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:50.470941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-577d2938-ad35-45a7-be99-4436c1a4b64c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Sep 13 16:20:50.471495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 925/1850] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:51.483356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:51.485570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:51.492389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:51.492864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:51.493299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:51.493992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:51.494443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:51.494866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:51.525254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b5b7a7a-c245-414a-a849-1ac8277c5d13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Sep 13 16:20:51.525810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 926/1851] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:52.538196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:52.540603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:52.546724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:52.547240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:52.547683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:52.548959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:52.549445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:52.549872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:52.578508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c5dff6b-4ce3-4369-8bae-d3dacf955cdf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Sep 13 16:20:52.579092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 926/1852] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:53.590929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:53.593049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:53.600147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:53.600743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:53.601186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:53.601891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:53.602378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:53.602801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:53.633593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-118d3ccf-2969-4e11-97b1-4310248a4610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046581 Sep 13 16:20:53.634293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 927/1853] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:54.646405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:54.648612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:54.650601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:20:54.650741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:20:54.657410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:54.658625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:54.659276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:54.659993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:54.660442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:54.660862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:54.692398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e8ddd229-c0db-4315-b90c-0aece713c314 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050640 Sep 13 16:20:54.692965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 927/1854] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:55.704899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:55.707369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:55.713896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:55.714371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:55.714807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:55.715526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:55.715979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:55.716402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:55.746770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04257474-7374-44a0-964f-10ddf1da2dea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045818 Sep 13 16:20:55.747353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 928/1855] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:56.759912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:56.762070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:56.768450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:56.768925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:56.769427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:56.770216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:56.770659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:56.771111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:56.800323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cfb635d1-e3ed-4722-8c57-d8e6387af58d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Sep 13 16:20:56.801419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 928/1856] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:57.813091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:57.815245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:57.822435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:57.823011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:57.823516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:57.824279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:57.824923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:57.825361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:57.856093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32fe8dc6-9ca2-458c-8bda-656a23a4b0d6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Sep 13 16:20:57.856647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 929/1857] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:58.868663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:58.870826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:58.877177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:58.877664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:58.878100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:58.878865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:58.879356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:58.879782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:58.911082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59f5a5e3-7d4d-499e-96b0-5b9b2c1a6bb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Sep 13 16:20:58.916283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 929/1858] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:20:59.923724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:20:59.925938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:20:59.932476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:59.932961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:59.933398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:59.934089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:20:59.934543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:20:59.934993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:20:59.965500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee80e0ae-6454-4bd9-b261-36d4df9dc937 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045823 Sep 13 16:20:59.966057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 930/1859] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:20:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:00.977587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:00.979768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:00.986060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:00.986539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:00.987001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:00.987680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:00.988129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:00.988548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:01.018904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8331d04b-9b8d-4ccc-8342-5ab9da33a59f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Sep 13 16:21:01.019530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 930/1860] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:02.031764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:02.034025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:02.037706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:02.041288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:02.041848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:02.042361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:02.043173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:02.043634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:02.044097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:02.079362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc8eb526-bda3-4e80-ba39-188ac75aab0c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051936 Sep 13 16:21:02.080178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 931/1861] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:03.092439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:03.094612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:03.101682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:03.102012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:03.102450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:03.103168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:03.103622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:03.104048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:03.140434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da19ed1c-6992-49f6-8fb3-2789cb5bde51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051824 Sep 13 16:21:03.140997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 931/1862] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:04.152400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:04.154510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:04.161125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:04.162062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:04.162507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:04.163217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:04.163663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:04.164080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:04.196388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f5ca2e9-d05f-463f-9014-bd7d105aad02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047827 Sep 13 16:21:04.196956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 932/1863] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:05.209217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:05.211400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:05.217873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:05.218458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:05.218806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:05.219547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:05.219994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:05.220417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:05.249607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84a9eb0d-ac5e-42a0-8e2e-4f34c349091f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 Sep 13 16:21:05.250160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 932/1864] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:06.262535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:06.264817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:06.271276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:06.271778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:06.272281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:06.273044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:06.273503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:06.273930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:06.305426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64b5503d-dd30-4fb2-8f3d-8a3edeb4a9e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047546 Sep 13 16:21:06.306138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 933/1865] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:07.317424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:07.320410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:07.326802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:07.327327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:07.327763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:07.328458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:07.328909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:07.329332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:07.332886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:07.359180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a71abcd1-4776-4941-88d2-5c84cb4a0884 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045582 Sep 13 16:21:07.359737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 933/1866] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:21:08.373148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:08.375294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:08.381635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:08.382121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:08.382554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:08.383277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:08.383728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:08.384151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:08.414509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-68235842-2809-49ab-8619-bcbffc02532a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045576 Sep 13 16:21:08.415092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 934/1867] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:09.426791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:09.429500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:09.435586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:09.436104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:09.436550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:09.437445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:09.437896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:09.438319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:09.468304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb5c128d-64f4-4e05-8474-94bef73ab8f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Sep 13 16:21:09.469084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 934/1868] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:10.480729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:10.482878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:10.489429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:10.489907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:10.490342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:10.491066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:10.492095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:10.492520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:10.523911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c881d92d-2305-470a-8898-9fa3a8bba3fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047092 Sep 13 16:21:10.524480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 935/1869] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:21:11.536800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:11.539466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:11.545814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:11.546292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:11.546724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:11.547439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:11.547895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:11.548316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:11.577955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cccd9e56-31c4-4a56-8104-f46fb47a4ad2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Sep 13 16:21:11.578726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 935/1870] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:12.590326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:12.592474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:12.598762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:12.599273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:12.599711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:12.600397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:12.600849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:12.601277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:12.630770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20547ea6-294b-4de8-a808-0aa98b1b06b6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Sep 13 16:21:12.631361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 936/1871] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:13.643935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:13.646076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:13.653362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:13.653837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:13.654269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:13.654969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:13.655417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:13.655837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:13.685605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f029603-a398-41c7-9f0f-f72d64d40253 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045567 Sep 13 16:21:13.686150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 936/1872] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:14.697978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:14.700165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:14.713269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:14.713749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:14.714185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:14.714875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:14.715355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:14.715790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:14.719352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:14.745950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab3055bc-3ba3-4d0f-9896-ae3f9d2724df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052212 Sep 13 16:21:14.746517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 937/1873] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:15.759207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:15.761315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:15.763812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:15.769133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:15.769628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:15.770069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:15.770809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:15.771291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:15.771721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:15.805322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ce1a38d-331b-4876-b7b7-d623f254f6e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051196 Sep 13 16:21:15.806101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 937/1874] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:16.818017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:16.820099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:16.826518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:16.827031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:16.827468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:16.828153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:16.828605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:16.829028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:16.859290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99dcbcb0-8ce8-4d6d-854b-ee05a4d40f3c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Sep 13 16:21:16.859851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 938/1875] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:17.872230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:17.874458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:17.880915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:17.881395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:17.881833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:17.882516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:17.883706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:17.884247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:17.913605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94b2afeb-3f40-4e77-9430-cc45d8fe5638 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Sep 13 16:21:17.914666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 938/1876] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:18.925817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:18.928158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:18.936313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:18.936913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:18.937364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:18.938069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:18.938526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:18.938989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:18.970416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9f09575-557a-4453-9636-207186f9bacb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048428 Sep 13 16:21:18.974994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 939/1877] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:19.983675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:19.985736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:19.992147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:19.992627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:19.993062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:19.993756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:19.994209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:19.994634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:20.023048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b82a0602-3247-436f-be04-2e2206ddcb36 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Sep 13 16:21:20.023601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 939/1878] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:21.036151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:21.038451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:21.045004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:21.045495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:21.045936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:21.046638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:21.047137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:21.047573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:21.077429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bba7defc-9ebf-42fd-8f89-f83bd53f0678 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Sep 13 16:21:21.077984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 940/1879] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:22.090498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:22.092691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:22.099070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:22.099550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:22.099986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:22.100667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:22.101117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:22.101542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:22.130360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4a074a6-8188-4240-b145-e63bc25f9d79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Sep 13 16:21:22.130935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 940/1880] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:23.142958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:23.145041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:23.151551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:23.152034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:23.152477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:23.153171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:23.153628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:23.154054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:23.184969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b7bf000-24c4-448e-92a6-4f574ecfd82b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046022 Sep 13 16:21:23.185513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 941/1881] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:24.198283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:24.200449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:24.206779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:24.207294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:24.207735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:24.208424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:24.208879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:24.209338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:24.239120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0be50cc-41e0-440b-9471-77fb739280e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Sep 13 16:21:24.239664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 941/1882] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:25.252524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:25.254625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:25.261066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:25.261544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:25.261982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:25.262667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:25.263149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:25.263573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:25.293481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-151458bf-b953-4fb9-a8ce-15ddfa6444fe tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Sep 13 16:21:25.294024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 942/1883] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:26.306056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:26.308545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:26.315152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:26.315635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:26.316180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:26.316877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:26.317329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:26.317753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:26.348186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cad581c6-a586-4e73-a7a5-12d4ffda7896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Sep 13 16:21:26.348735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 942/1884] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:27.360848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:27.363030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:27.369583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:27.370097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:27.370645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:27.371367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:27.371826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:27.372257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:27.402230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40e69b5e-af3e-4b92-8a00-2be10a255858 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Sep 13 16:21:27.402786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 943/1885] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:28.415487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:28.418179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:28.424588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:28.425069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:28.425505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:28.426186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:28.426637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:28.427092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:28.456345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86d81d94-8956-484c-9f96-e57a8810eecb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Sep 13 16:21:28.456891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 943/1886] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:29.469177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:29.471297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:29.477168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:29.477653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:29.478091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:29.478782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:29.479263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:29.480371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:29.510112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8bfc5f95-f58c-4691-a643-14d7e8554489 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Sep 13 16:21:29.510672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 944/1887] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:30.522076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:30.524244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:30.531012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:30.531491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:30.531923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:30.532600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:30.533045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:30.533463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:30.562723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c13b005-03ba-4ea2-a120-744d373fe1a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Sep 13 16:21:30.563285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 944/1888] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:31.575776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:31.577906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:31.584227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:31.584707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:31.585146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:31.585830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:31.586284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:31.586712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:31.615917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30738a8a-41ac-4572-a536-51d65b3f4fc2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Sep 13 16:21:31.616461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 945/1889] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:32.627756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:32.629817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:32.636841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:32.637327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:32.637764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:32.638453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:32.638966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:32.639399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:32.668154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e3456c7b-0a9f-4d96-ba2f-48b58b91fdc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Sep 13 16:21:32.668706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 945/1890] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:33.680882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:33.682985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:33.685855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:33.691028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:33.691507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:33.691943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:33.692628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:33.693082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:33.693506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:33.722373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59437719-8180-4d58-b085-d2a69b26d19e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045461 Sep 13 16:21:33.722943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 946/1891] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:34.735089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:34.737176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:34.743540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:34.744023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:34.744459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:34.745144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:34.745596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:34.746105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:34.774568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b4747ef4-983d-4596-aab0-defbdb801eb7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Sep 13 16:21:34.775149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 946/1892] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:35.787850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:35.789896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:35.797221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:35.797697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:35.798130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:35.798813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:35.799304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:35.799727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:35.828211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e3e208d-5a94-45fb-9ff2-aa4c13cb742c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Sep 13 16:21:35.828751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 947/1893] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:36.841630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:36.843727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:36.850241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:36.850722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:36.851197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:36.851887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:36.852340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:36.852765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:36.883197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab668d27-996a-48bc-9c05-755e31571e24 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Sep 13 16:21:36.883746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 947/1894] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:37.895612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:37.897748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:37.904216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:37.904692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:37.905126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:37.905812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:37.906264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:37.906688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:37.935752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a808927-e81a-4b8c-927e-d1623537bc7c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Sep 13 16:21:37.936287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 948/1895] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:38.948031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:38.950998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:38.957356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:38.957766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:38.958198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:38.958876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:38.959400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:38.959819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:38.962116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:38.990124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e36a6d2-7c63-4174-b493-3cf053713ab4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Sep 13 16:21:38.990662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 948/1896] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:40.002375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:40.004560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:40.010951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:40.011383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:40.011821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:40.013127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:40.013581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:40.014008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:40.043436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03917654-ede3-441a-855b-5a6e225c584a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Sep 13 16:21:40.043995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 949/1897] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:41.055206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:41.057386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:41.063931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:41.064418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:41.064871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:41.065549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:41.066000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:41.066428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:41.095621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7db18a68-1407-474b-b831-5c339145d753 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Sep 13 16:21:41.096165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 949/1898] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:42.108969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:42.111255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:42.117586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:42.118064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:42.118497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:42.119220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:42.119673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:42.120103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:42.149510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67ff187c-abf0-4129-bc36-d9124cb85d3b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Sep 13 16:21:42.149985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 950/1899] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:43.161895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:43.164035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:43.170667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:43.171223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:43.171649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:43.172331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:43.172781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:43.173207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:43.203296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b437099-fcaf-4778-a007-1f6c73c9d7d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Sep 13 16:21:43.203847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 950/1900] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:44.215327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:44.218152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:44.224448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:44.224924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:44.225358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:44.226070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:44.226519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:44.226963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:44.255247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1fdcd0f0-d23d-4fd8-bd76-7ea3455e9ee9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Sep 13 16:21:44.255733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 951/1901] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:45.267910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:45.270086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:45.276481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:45.276957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:45.277389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:45.278066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:45.278514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:45.278965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:45.309299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61346feb-7d6a-4891-87ce-73a7fbad2b2a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Sep 13 16:21:45.309772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 951/1902] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:46.321960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:46.324092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:46.330740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:46.331262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:46.331700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:46.332394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:46.332849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:46.333279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:46.335628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:46.364527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a49c17d3-dee6-40a6-89e1-77f0184082f2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046644 Sep 13 16:21:46.365075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 952/1903] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:47.377513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:47.379694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:47.382109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:47.387360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:47.387842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:47.388284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:47.388975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:47.389429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:47.389857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:47.418727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ff8ef147-1647-4ad6-9a2d-c3d90814e160 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Sep 13 16:21:47.419304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 952/1904] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:48.431746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:48.433953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:48.440991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:48.441470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:48.441904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:48.442597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:48.443073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:48.443508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:48.472688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92036bfc-88cf-4349-a8a5-4848b55f0095 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Sep 13 16:21:48.473154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 953/1905] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:49.485508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:49.487707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:49.494216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:49.494696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:49.495164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:49.495849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:49.496300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:49.496726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:49.525713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d429ef6a-532e-4728-baa6-cc98227ce77c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Sep 13 16:21:49.526260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 953/1906] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:50.537891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:50.540088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:50.547543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:50.548028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:50.548462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:50.549433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:50.550260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:50.550724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:50.582782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8309ab21-4117-48e4-95d9-209cbca89eef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048940 Sep 13 16:21:50.583375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 954/1907] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:51.596415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:51.598587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:51.604890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:51.605364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:51.605792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:51.606475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:51.606936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:51.607358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:51.637139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96520202-7b63-49d4-80bb-f6de5267904c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Sep 13 16:21:51.637684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 954/1908] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:52.649846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:52.652004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:52.658269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:52.658745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:52.659215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:52.659901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:52.660352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:52.660773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:52.691049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59f8905c-34a2-4767-b1fd-910a32dba20b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 13 16:21:52.691599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 955/1909] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:53.703977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:53.706109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:53.712392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:53.712894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:53.713322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:53.713995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:53.714439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:53.714854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:53.743932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e4ee54e-ccdb-49ac-8c07-4cad7ba44bad tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Sep 13 16:21:53.744498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 955/1910] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:54.756181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:54.758391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:54.765724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:54.766203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:54.766635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:54.767367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:54.767813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:54.768232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:54.798569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bafddb44-2896-4c8e-aa6a-dfee952fd221 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Sep 13 16:21:54.799164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 956/1911] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:55.810794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:55.814054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:55.820417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:55.820892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:55.821327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:55.822006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:55.822454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:55.822884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:55.855639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea88bfbc-d848-4db0-bc52-44d9b2cbcdfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048687 Sep 13 16:21:55.856190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 956/1912] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:56.868562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:56.870770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:56.877205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:56.877683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:56.878116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:56.878803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:56.879280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:56.879704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:56.915684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc859139-95e6-40f7-a783-dadcf43bae68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051054 Sep 13 16:21:56.916235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 957/1913] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:57.928523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:57.930662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:57.937745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:57.938421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:57.938857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:57.939563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:57.940017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:57.940436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:57.969334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9104373c-815e-4840-b2e4-12bcf2b74e0e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Sep 13 16:21:57.969878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 957/1914] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:58.981926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:58.984264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:21:58.990662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:58.991173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:58.991600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:58.992278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:21:58.992721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:21:58.993138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:21:59.022492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78e33386-9e49-4429-a50f-3bf4fc39c136 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Sep 13 16:21:59.023057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 958/1915] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:21:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:00.035247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:00.037472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:00.043879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:00.044361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:00.045099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:00.045792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:00.046245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:00.046675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:00.075770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd9775fb-f7b1-45a1-8782-38fe5e1806ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 13 16:22:00.076322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 958/1916] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:01.088807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:01.091110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:01.098018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:01.098503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:01.098958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:01.099643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:01.100092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:01.100515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:01.129621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4122fbce-326a-407f-a077-7c97eab7bc30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Sep 13 16:22:01.130166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 959/1917] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:02.141724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:02.143934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:02.150141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:02.150618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:02.151092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:02.151771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:02.152214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:02.152631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:02.181660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19ebeec6-e0ea-4842-b36b-773aee9a9d75 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Sep 13 16:22:02.182196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 959/1918] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:03.193987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:03.196154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:03.202406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:03.202882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:03.203347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:03.204029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:03.204502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:03.204926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:03.234045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04e099bc-d2c3-4dde-b356-cce49b7bf55e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Sep 13 16:22:03.234592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 960/1919] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:04.246225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:04.248410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:04.254745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:04.255260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:04.255700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:04.256383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:04.256835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:04.257258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:04.286094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-261fec7a-f57d-4dca-a3fc-e5e504fa1679 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Sep 13 16:22:04.286632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 960/1920] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:05.298491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:05.301879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:05.304302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:05.309498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:05.309975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:05.310407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:05.311132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:05.311578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:05.312001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:05.341948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b4d5cfa-4778-47b4-8f4b-f35bf84d62de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047556 Sep 13 16:22:05.342497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 961/1921] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:06.354274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:06.356445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:06.363648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:06.364129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:06.364566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:06.365256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:06.365706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:06.366131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:06.394685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-899a2303-6935-431c-9082-21259daddb78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Sep 13 16:22:06.395258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 961/1922] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:07.407051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:07.409198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:07.415834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:07.416319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:07.416786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:07.417480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:07.417934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:07.418362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:07.448593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34c9d9d7-7f88-4bc1-a3eb-f9416b01bd37 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Sep 13 16:22:07.449135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 962/1923] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:08.461085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:22:08.461651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:22:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:22:08.643111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:08.645883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:08.651756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:08.652238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:08.652670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:08.653349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:08.653799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:08.654220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:08.683371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0540d58b-886d-4d4c-be4e-ba1a11801b7f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227371 Sep 13 16:22:08.683919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 962/1924] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:09.695941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:09.697974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:09.704363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:09.704841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:09.705279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:09.705968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:09.706958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:09.707397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:09.736190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9db85209-6759-4931-8801-d951eb317d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Sep 13 16:22:09.736727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 963/1925] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:10.748573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:10.750711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:10.756696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:10.757172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:10.757603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:10.758278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:10.758722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:10.759167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:10.761567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:10.788862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a684cc17-b04a-487a-84e9-4bb285b3653b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Sep 13 16:22:10.789401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 963/1926] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:11.801567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:11.803719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:11.810069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:11.810551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:11.811016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:11.811708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:11.812161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:11.812619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:11.841580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1192d825-c1da-4362-8a58-272983a928d5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 13 16:22:11.842153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 964/1927] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:12.853679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:12.855868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:12.862113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:12.862588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:12.863135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:12.864018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:12.864490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:12.864910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:12.893241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4fa07f89-4ca1-453f-9d13-92c411a7898a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Sep 13 16:22:12.893787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 964/1928] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:13.905669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:13.907780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:13.914865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:13.915368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:13.915800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:13.916487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:13.916931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:13.917347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:13.946888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0237213-1710-40bb-9f55-fc7a5ca5ddda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Sep 13 16:22:13.947451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 965/1929] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:14.959201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:14.961390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:14.963378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:22:14.963525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:22:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:22:14.970012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:14.970496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:14.970955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:14.971651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:14.972103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:14.972533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:15.004265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-faf7604f-79f7-483e-8885-678ed615a3ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Sep 13 16:22:15.005480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 965/1930] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:16.019188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:16.022004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:16.028381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:16.028861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:16.029298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:16.029987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:16.030440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:16.030867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:16.060147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee066945-355a-40ef-9025-bd46efb222a5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Sep 13 16:22:16.060691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 966/1931] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:17.073457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:17.075615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:17.082016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:17.082701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:17.083961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:17.084833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:17.085867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:17.085867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:17.115915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35970fd3-65d5-4d4e-b113-93e35c03a0da tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Sep 13 16:22:17.116469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 966/1932] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:18.128267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:18.131032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:18.137346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:18.137823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:18.138258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:18.138957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:18.139411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:18.139832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:18.142139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:18.170870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0ccc5c1-9105-4b45-9d6d-1b0c2643b9d0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Sep 13 16:22:18.171440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 967/1933] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:19.184216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:19.186371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:19.188711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:19.194547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:19.195057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:19.195493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:19.196175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:19.196803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:19.197232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:19.226415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07feb888-f36b-4dd7-9396-bbdae39da945 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046520 Sep 13 16:22:19.226974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 967/1934] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:20.238737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:20.240935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:20.247390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:20.247875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:20.248315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:20.249009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:20.249463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:20.249892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:20.279281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a779157b-f381-44b8-afe5-8cdad1bca506 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Sep 13 16:22:20.279835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 968/1935] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:21.292677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:21.294803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:21.301539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:21.302037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:21.303223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:21.303914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:21.304364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:21.304789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:21.333406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd810769-8d99-4506-92a5-fe8eb4cd79f0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 13 16:22:21.333945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 968/1936] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:22:22.345734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:22.347994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:22.350594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:22:22.350738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments (ip 10.222.0.50) !!! Sep 13 16:22:22.357141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:22.357621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:22.358057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:22.358749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:22.359234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:22.359663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:22.389006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ad7069b-e00a-47a2-b354-1844a9ff085d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047183 Sep 13 16:22:22.389549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 969/1937] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:23.401932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:23.404323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:23.410692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:23.411225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:23.411643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:23.413109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:23.413563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:23.413986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:23.442697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e2b3ebad-ce63-4b3a-a8de-2d10661509bd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Sep 13 16:22:23.443819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 969/1938] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:24.455861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:24.458011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:24.464487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:24.464969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:24.465409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:24.466099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:24.466557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:24.467009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:24.496084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-49f4b202-ac64-4f52-b8e4-88989aa3ce7e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Sep 13 16:22:24.496638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 970/1939] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:25.508683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:25.510841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:25.517228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:25.517729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:25.518164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:25.518846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:25.519324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:25.519746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:25.549647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31f8c0b8-dec4-4aaa-9d4a-44e872d1937b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Sep 13 16:22:25.550200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 970/1940] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:26.562703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:26.564912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:26.571789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:26.572271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:26.572710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:26.573401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:26.573866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:26.574292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:26.603663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5bec90e-e881-43a0-b57a-0b6518ce8543 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Sep 13 16:22:26.604212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 971/1941] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:27.616696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:27.619457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:27.625910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:27.626388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:27.626821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:27.627541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:27.627990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:27.628407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:27.658302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df2c7df3-feaf-4abd-8170-319fa063c295 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046071 Sep 13 16:22:27.658855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 971/1942] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:28.670771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:28.673064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:28.679848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:28.680329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:28.680767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:28.681454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:28.681913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:28.682334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:28.711830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-450a60dc-77b7-4b9a-8194-76f3dbe467c1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Sep 13 16:22:28.712370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 972/1943] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:22:29.724254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:29.726390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:29.732765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:29.733266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:29.733705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:29.734383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:29.734834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:29.735284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:29.764375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a10b2e40-10ec-4cf8-baf9-86608c55de78 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Sep 13 16:22:29.764937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 972/1944] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:30.777429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:30.779575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:30.785513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:30.785988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:30.786418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:30.787133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:30.787578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:30.787995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:30.816963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98f76f40-a9a9-4987-81a7-7c59608b15d3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Sep 13 16:22:30.817504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 973/1945] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:31.829237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:31.831461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:31.837982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:31.838465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:31.838937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:31.839616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:31.840070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:31.840495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:31.869886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-63175212-4d89-4004-ab85-93541ec94987 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Sep 13 16:22:31.870431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 973/1946] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:32.881478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:32.884358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:32.890885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:32.891397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:32.891829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:32.892508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:32.893077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:32.893500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:32.923803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e65e7a7-b7ca-4240-86c9-3ffdb0e8c234 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046223 Sep 13 16:22:32.924606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 974/1947] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:33.936470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:33.938614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:33.945115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:33.945596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:33.946092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:33.946787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:33.947274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:33.947703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:33.976846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df15f9df-2bb9-4cb5-a1b0-d66b755af305 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Sep 13 16:22:33.977969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 974/1948] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:22:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:34.989592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:22:34.991776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:34.998922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:34.999421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:34.999852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:35.000542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:35.000993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:35.001416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:35.081233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cae7814-1ea0-4607-9701-4b3488671364 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/action" status: 200 len: 76504 microversion: 2.1 time: 0.095206 Sep 13 16:22:35.081886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 975/1949] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:22:34 2022] POST /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c/action => generated 76504 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:22:43.848924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:43.849458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:43.855983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:43.856459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:43.856897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:43.857587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:43.858038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:43.858467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:43.861020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=72 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:43.883909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:22:43.963916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-77fa3356-d26a-4a3f-b081-16b465c02a0c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 204 len: 0 microversion: 2.1 time: 0.118759 Sep 13 16:22:43.964754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 975/1950] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:22:43 2022] DELETE /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:22:43.973740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:43.974458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:43.976999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:43.983467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:43.983941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:43.984373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:43.985051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:43.985497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:43.985917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:44.165178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:44.173774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08c9e702-1b3c-4de0-b1c6-88d20a54a13e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.204240 Sep 13 16:22:44.174324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 976/1951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:43 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:45.198357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:45.199096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:45.205436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:45.205918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:45.206359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:45.207086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:45.207543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:45.207968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:45.389557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:45.397547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9f7ae38-8fdf-4dc2-8180-963f55138ee6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.204150 Sep 13 16:22:45.398105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 976/1952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:45 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:46.420181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:46.420798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:46.427524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:46.428006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:46.428448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:46.429139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:46.429589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:46.430015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:46.558583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:46.567169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d0d9d5b-ace2-4306-b60d-e85f10028490 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150765 Sep 13 16:22:46.567601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 977/1953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:46 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:22:47.593451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:47.594270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:47.600701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:47.601126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:47.601567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:47.602300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:47.602988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:47.603424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:47.732853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:47.741005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f67c5abc-4d03-4acb-8f3f-f28550a0d83a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151418 Sep 13 16:22:47.741567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 977/1954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:47 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:48.764755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:48.765389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:48.771776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:48.772250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:48.772681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:48.773360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:48.773806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:48.774225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:48.778566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=64 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:48.907340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:48.915427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5555b7f-266c-4688-a099-ea52f02a77bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.154673 Sep 13 16:22:48.915986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 978/1955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:48 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:49.939577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:49.940190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:49.942558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:49.947719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:49.948195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:49.948629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:49.949864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:49.950312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:49.950734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:50.099422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:50.108107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b6c2ece-21ee-41b3-86db-dee7497d2b9b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.172311 Sep 13 16:22:50.108687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 978/1956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:49 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:51.132086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:51.132691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:51.139616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:51.140091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:51.140522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:51.141200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:51.141645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:51.142064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:51.276581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:51.285367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c70073d-f8bf-4318-94f9-b748ee8322bc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.157244 Sep 13 16:22:51.285932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 979/1957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:51 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:22:52.307668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:52.308276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:52.315021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:52.315496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:52.315926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:52.316600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:52.317042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:52.317460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:52.443848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:52.452163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6025fc1e-b7c6-4b10-8ffc-b5f80f50523b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148254 Sep 13 16:22:52.452722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 979/1958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:52 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:53.475611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:53.476230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:53.483367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:53.483847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:53.484281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:53.484973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:53.485423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:53.485875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:53.615466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:53.624578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48b73ee0-f3d6-4d3f-b98c-e9d97d5ec780 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152779 Sep 13 16:22:53.625148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 980/1959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:53 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:54.646677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:54.647269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:54.653964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:54.654451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:54.654886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:54.655600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:54.656056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:54.656481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:54.781884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:54.789932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e844755-d2f2-4db1-9ee7-55f238a95df5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147151 Sep 13 16:22:54.790489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 980/1960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:54 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:55.812919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:55.813526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:55.819941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:55.820411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:55.820852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:55.821518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:55.821962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:55.822384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:55.950761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:55.958827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1d701c8-87fc-407b-95dd-62b9aaada468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149845 Sep 13 16:22:55.959416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 981/1961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:55 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:56.983456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:56.984074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:56.990430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:56.990919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:56.991383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:56.992073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:56.992530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:56.992959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:57.129413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:57.138180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef778f10-81f5-4825-8a42-c7e1f2245c07 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.159227 Sep 13 16:22:57.138845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 981/1962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:56 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:58.161953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:58.162565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:58.169589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:58.170068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:58.170509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:58.171221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:58.171795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:58.172239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:58.302247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:58.311146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b646479-06a2-424a-a2d8-e060abc0164f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153023 Sep 13 16:22:58.311707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 982/1963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:58 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:59.334417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:59.335068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:22:59.341494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:59.341972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:59.342412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:59.343124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:22:59.343575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:22:59.343997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:22:59.473777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:22:59.482116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-305f936e-b39e-417d-9b02-be552a0c711a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151522 Sep 13 16:22:59.482666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 982/1964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:22:59 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:00.504799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:00.505413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:00.511701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:00.512182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:00.512624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:00.513306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:00.513753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:00.514178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:00.640904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:00.649022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dba750f3-fd35-4f16-94ce-408ab3ebd381 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148065 Sep 13 16:23:00.649590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 983/1965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:00 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:01.671812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:01.672374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:01.679194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:01.679674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:01.680105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:01.680788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:01.681233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:01.681653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:01.809026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:01.817285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09948bbf-9097-4189-a9e1-944909683a18 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149626 Sep 13 16:23:01.817835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 983/1966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:01 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:02.841773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:02.842382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:02.848711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:02.849182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:02.849622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:02.850313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:02.850760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:02.851211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:02.980957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:02.989891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15c09d6e-9b47-4eaa-820b-f29ae79f77ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152442 Sep 13 16:23:02.990455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 984/1967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:02 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:04.013351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:04.014238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:04.020546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:04.021037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:04.021448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:04.022130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:04.022572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:04.023033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:04.151023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:04.159216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0735ece-ffdd-42e8-b280-1aac2db0e398 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150227 Sep 13 16:23:04.159852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 984/1968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:04 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:05.182360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:05.182990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:05.190256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:05.190659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:05.191143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:05.191837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:05.192289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:05.192717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:05.324625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:05.333340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b74db4a-cccd-4c6c-98b2-9ef7eebb595a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.155062 Sep 13 16:23:05.333913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 985/1969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:05 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:06.355888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:06.356497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:06.363222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:06.363702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:06.364137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:06.364823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:06.365276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:06.365699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:06.492211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:06.500812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1e518e0-e34a-4611-bbb7-47da5627db2a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148813 Sep 13 16:23:06.501375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 985/1970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:06 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:07.110670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:07.111271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:07.117813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:07.118369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:07.119076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:07.119730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:07.120249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:07.120679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:07.146068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:23:07.222394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7ff4f1d-53ef-456c-8a1f-5acd9c7efd10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 204 len: 0 microversion: 2.20 time: 0.115778 Sep 13 16:23:07.225924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 986/1971] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Sep 13 16:23:07 2022] DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:23:07.232907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:07.233618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:07.240300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:07.240782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:07.241217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:07.241904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:07.242351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:07.242771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:07.370518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:07.379860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:07.381297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:07.382434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-635bcb83-8c36-4b0c-9f39-0b288b80b25e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154233 Sep 13 16:23:07.382998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 986/1972] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:07.525313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:07.525999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:07.532508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:07.532985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:07.533429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:07.534115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:07.534569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:07.535018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:07.663765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:07.672316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-295d6c71-83e5-4ede-862a-6fdbe2be2eef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151322 Sep 13 16:23:07.672891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 987/1973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:07 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:08.408663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:08.409257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:08.415635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:08.416117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:08.416556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:08.417242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:08.417693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:08.418116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:08.547452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:08.556326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:08.557767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:08.558935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9c203ab-6fb0-4450-8dd8-a94d4dc734e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154585 Sep 13 16:23:08.559495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 987/1974] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:23:08.695570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:08.696114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:08.703499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:08.703987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:08.704427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:08.705123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:08.705578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:08.706009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:08.839450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:08.848208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e5733f6-7899-4489-ba22-b7caf9454e6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.156543 Sep 13 16:23:08.848775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 988/1975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:08 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:09.584807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:09.585428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:09.591856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:09.592335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:09.592770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:09.593456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:09.593903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:09.594323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:09.721047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:09.729498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:09.730957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:09.732799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8153da8e-4772-489f-99ce-e11d0ecbd737 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151338 Sep 13 16:23:09.733567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 988/1976] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:09.870783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:09.871432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:09.877887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:09.878392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:09.878825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:09.879533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:09.879981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:09.880398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:10.012626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:10.021363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1a99ecf-e155-46f4-bba0-6cb3c90b2b4f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.154327 Sep 13 16:23:10.022245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 989/1977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:09 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:10.757497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:10.758110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:10.764746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:10.765226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:10.765671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:10.766357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:10.766808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:10.767256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:10.896079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:10.905271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:10.906718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:10.907923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b0755ab-3724-4818-b7e9-ae80fdf0ace8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154275 Sep 13 16:23:10.908481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 989/1978] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:11.045358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:11.045990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:11.052960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:11.053435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:11.054123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:11.054821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:11.055293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:11.055713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:11.184616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:11.193159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a98f5eb3-c452-4d45-9d57-eaac113f8643 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152005 Sep 13 16:23:11.193725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 990/1979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:11 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:11.933971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:11.934539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:11.941111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:11.941589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:11.942028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:11.942721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:11.943208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:11.943635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:11.947573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:12.078692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:12.087288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:12.088735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:12.089900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3df1e3eb-5370-4f94-87cc-8f8edc92007d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.159874 Sep 13 16:23:12.090457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 990/1980] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:12.217658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:12.218256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:12.224531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:12.225003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:12.225442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:12.226113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:12.226555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:12.226997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:12.354253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:12.362486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2869163-c2f2-450e-93a8-509732c2a849 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149609 Sep 13 16:23:12.363081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 991/1981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:12 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:13.115628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:13.116269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:13.122762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:13.123930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:13.124461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:13.125164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:13.125621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:13.126050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:13.256938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:13.265529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:13.267002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:13.268170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67c5b75f-5428-47aa-b22c-dd8307ca5712 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156441 Sep 13 16:23:13.268733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 991/1982] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:13.385605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:13.386216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:13.392711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:13.393187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:13.393622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:13.394308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:13.394768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:13.395218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:13.520522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:13.528606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1660c7e-e839-4b20-8e52-e57464a120a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.146862 Sep 13 16:23:13.529758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 992/1983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:13 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:14.293472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:14.294074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:14.300651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:14.301071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:14.301502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:14.302182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:14.302635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:14.303084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:14.432568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:14.442060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:14.443730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:14.445052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc7973b3-3fc4-41ee-b286-34f31b1f2113 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155374 Sep 13 16:23:14.445621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 992/1984] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:14.551976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:14.552541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:14.555266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:14.561920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:14.562409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:14.562844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:14.563632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:14.564080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:14.564505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:14.568975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:14.692732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:14.700835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c9b4cfd-dccb-419b-985c-336afc67ed4a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152746 Sep 13 16:23:14.701929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 993/1985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:14 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:15.470171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:15.470778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:15.477118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:15.477597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:15.478033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:15.478714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:15.479197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:15.479621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:15.605100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:15.614186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:15.615667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:15.616830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cfbf4522-9ff0-4828-b0a7-e5443eee1bb8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151232 Sep 13 16:23:15.617400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 993/1986] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:15.724055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:15.724668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:15.730994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:15.731478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:15.731913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:15.733227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:15.733681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:15.734101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:15.863023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:15.871088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac197d78-3f0e-42b1-9947-a22f8dd1eb76 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150858 Sep 13 16:23:15.871651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 994/1987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:15 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:16.641650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:16.642285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:16.648797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:16.649285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:16.649720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:16.650407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:16.651159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:16.651590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:16.776091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:16.784673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:16.786110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:16.787285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d81e067-6b64-469e-a556-0adabee54abf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.149661 Sep 13 16:23:16.787847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 994/1988] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:16.893590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:16.894206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:16.900644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:16.901125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:16.901564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:16.902251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:16.902707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:16.903162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:17.033967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:17.042036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e65adad3-b270-43bc-8ab4-3c6aeb8fa8a3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152291 Sep 13 16:23:17.042597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 995/1989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:16 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:17.813363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:17.813962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:17.820655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:17.821128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:17.821556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:17.822233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:17.822679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:17.823126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:17.953629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:17.962004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:17.963475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:17.964887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba2c3039-56bc-46a5-a2b0-b4873ff693ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155889 Sep 13 16:23:17.965439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 995/1990] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:18.066335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.066972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:18.073685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:18.074162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:18.074589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:18.075299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:18.075767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:18.076188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:18.203287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:18.211430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f47728a2-ceb0-4de2-ae63-a95abbce9ae3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148916 Sep 13 16:23:18.211992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 996/1991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:18 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:18.989669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.990270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:18.996685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:18.997166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:18.997596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:18.998352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:18.999161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:18.999647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:19.162781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:19.171734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:19.173184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:19.174405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b792f37b-15d1-48b9-9438-3d6b88f641db tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.188665 Sep 13 16:23:19.174986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 996/1992] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:19.234350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:19.235023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:19.241341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:19.241814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:19.242244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:19.242951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:19.243398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:19.243819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:19.376907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:19.385418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f634eb69-ddb1-4e9a-a61d-4bc578f9cce1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.154915 Sep 13 16:23:19.386133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 997/1993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:19 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:20.199706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:20.200308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:20.203379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=38 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:20.208144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:20.208647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:20.209089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:20.209792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:20.210246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:20.210671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:20.339372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:20.348037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:20.349518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:20.350677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a869fe94-f369-49c4-ba2a-c4de12c0ad01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154872 Sep 13 16:23:20.351269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 997/1994] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:20.408982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:20.409644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:20.417647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:20.418129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:20.418559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:20.419464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:20.419915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:20.420338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:20.549832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:20.558203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58ec1719-e3f6-47a6-9747-667b607e4adc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153269 Sep 13 16:23:20.558759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 998/1995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:20 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:21.377234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:21.377776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:21.384072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:21.384606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:21.385042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:21.385719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:21.386166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:21.386585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:21.523074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:21.531716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:21.533158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:21.534325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4ef2757-9be8-45ca-b87a-b5fd0ecb248e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.162088 Sep 13 16:23:21.534877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 998/1996] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:21.581644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:21.582252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:21.588523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:21.589001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:21.589432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:21.590114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:21.590581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:21.591016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:21.720770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:21.728858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0f3110e-89dd-4cfd-90e2-fc985fff7484 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151660 Sep 13 16:23:21.729427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 999/1997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:21 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:22.559312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:22.559920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:22.567323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:22.567807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:22.568240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:22.568924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:22.569372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:22.569791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:22.700718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:22.710155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:22.711660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:22.712777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e9324b1-4558-4d58-8cf9-d45462f95ea8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.157565 Sep 13 16:23:22.713335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 999/1998] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:22.751887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:22.752491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:22.758744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:22.759254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:22.759685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:22.760410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:22.760804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:22.761221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:22.885944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:22.895255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0397f833-90c6-4104-a0f5-38e37dc7b818 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147196 Sep 13 16:23:22.895820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1000/1999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:22 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:23.739018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:23.739618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:23.745876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:23.746352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:23.746782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:23.747484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:23.747938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:23.748356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:23.878870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:23.887312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:23.888733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:23.890684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b693236-7930-48bd-976b-3d5ca30af056 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155438 Sep 13 16:23:23.891213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1000/2000] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:23.918847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:23.919483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:23.926415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:23.926888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:23.927350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:23.928032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:23.928483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:23.928903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:24.056189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:24.064423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6efb7e62-6c62-4aff-925f-8b9416da5949 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149338 Sep 13 16:23:24.064983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1001/2001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:23 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:24.915758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:24.916400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:24.923430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:24.923912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:24.924353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:24.925047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:24.925503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:24.925943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:25.052709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:25.061570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:25.063042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:25.064434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e38484c6-7d34-41f6-bb65-1bd3a681a49d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152333 Sep 13 16:23:25.064800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1001/2002] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:25.087316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:25.087946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:25.094954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:25.095381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:25.095819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:25.096518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:25.096971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:25.097406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:25.229678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:25.238151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6522bd55-a5de-4b48-af30-20af4c7dbeb5 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.154630 Sep 13 16:23:25.238718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1002/2003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:26.089939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:26.090550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:26.097689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:26.098173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:26.098611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:26.099330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:26.099788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:26.100215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:26.229309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:26.238433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:26.239892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:26.241048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-feed9f53-a0e0-4e18-bd03-fa2e7c1edfad tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155000 Sep 13 16:23:26.241607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1002/2004] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:26.260794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:26.261438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:26.268035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:26.268511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:26.268945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:26.269633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:26.270082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:26.270504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:26.399428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:26.408283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0497f6e-58b6-4396-a1bd-60e85ab9b644 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151271 Sep 13 16:23:26.408856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1003/2005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:26 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:27.267516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:27.268123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:27.275019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:27.275507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:27.275953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:27.276651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:27.277106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:27.277529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:27.408545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:27.417103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:27.418546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:27.419748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb29b11b-fcfb-4f91-bd50-022e8d1b5d89 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.157422 Sep 13 16:23:27.420307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1003/2006] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:27.431150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:27.431764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:27.438205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:27.438712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:27.439153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:27.439843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:27.440291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:27.440714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:27.564564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:27.572638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb71865c-cd48-4ba8-ab5f-8cb8028ac24e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.145595 Sep 13 16:23:27.573203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1004/2007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:27 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:28.445621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:28.446231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:28.452657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:28.453134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:28.453571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:28.454370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:28.454824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:28.455279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:28.585986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:28.596682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:28.597866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:28.598320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:28.598497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:28.599345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69901747-39a6-4fee-b6fc-33db04f184af tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.157547 Sep 13 16:23:28.599894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1004/2008] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:28.604801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:28.605215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:28.605647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:28.606325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:28.606769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:28.607216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:28.733130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:28.741283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a08aee54-a953-49c2-b6ef-486ceda5c087 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147983 Sep 13 16:23:28.741834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1005/2009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:28 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:29.624649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:29.625267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:29.631816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:29.632299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:29.632739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:29.633429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:29.633884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:29.634311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:29.763391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:29.764010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:29.768692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:29.770206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:29.770699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:29.771174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:29.771879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:29.772332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:29.772782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:29.777747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:29.779225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:29.780516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12b9b25f-f2b6-44b4-a38b-71826dd4657e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.159758 Sep 13 16:23:29.781083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1005/2010] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:29.898543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:29.906841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a013bfc-3a07-47a3-af00-198bae9226fd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147324 Sep 13 16:23:29.907433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1006/2011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:29 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:30.806941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:30.807544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:30.814975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:30.815452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:30.815890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:30.816574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:30.817019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:30.817439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:30.931877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:30.932494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:30.939557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:30.940053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:30.940496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:30.941198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:30.941645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:30.942074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:30.948977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:30.951143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:30.959936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:30.961439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:30.962617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a047057-b025-46ed-885f-73d76243662b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.159842 Sep 13 16:23:30.963206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1006/2012] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:31.080503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:31.088691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df7cad1c-d10e-4a08-8092-e78d759ee73a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.161644 Sep 13 16:23:31.089244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1007/2013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:31.988714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:31.989319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:31.995737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:31.996211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:31.996644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:31.997324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:31.997770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:31.998186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:32.113444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:32.114132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:32.121003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:32.121472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:32.122020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:32.122796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:32.123283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:32.123710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:32.131394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:32.142209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:32.145018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:32.146438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9f2f604-e4de-4c7f-83a4-6cd7b64b2cd6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.161660 Sep 13 16:23:32.147545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1007/2014] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:32.481752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:32.490618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76dc4067-93b5-4320-a7ff-58f84436efdd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.381766 Sep 13 16:23:32.491217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1008/2015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:33.181901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:33.182590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:33.189001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:33.189485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:33.189922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:33.190617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:33.191103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:33.191535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:33.325340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:33.328587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:33.330660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:33.331859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f267c4bb-f102-43d6-867f-8285884d8fb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154286 Sep 13 16:23:33.332411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1008/2016] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:33.513495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:33.514108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:33.521206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:33.521690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:33.522132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:33.522825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:33.523315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:33.523745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:33.652705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:33.654870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:33.662352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6f2c49d-7204-4fee-ba93-a328f42c6368 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152694 Sep 13 16:23:33.662916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1009/2017] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:33 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:34.356514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:34.357155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:34.363829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:34.364306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:34.364744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:34.365447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:34.365872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:34.366297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:34.493743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:34.502334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:34.503805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:34.504957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1dff869-5226-45da-aa18-41b4f442012a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152278 Sep 13 16:23:34.505511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1009/2018] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:34.685692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:34.686297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:34.693205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:34.693726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:34.694110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:34.694795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:34.695267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:34.695686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:34.824120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:34.832225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7895d062-d0b6-40eb-9332-5f3bd3122422 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150692 Sep 13 16:23:34.832784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1010/2019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:34 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:35.529553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:35.530154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:35.536635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:35.537117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:35.537552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:35.538240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:35.538689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:35.539142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:35.671452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:35.681349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:35.683068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:35.684218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb727cd0-ffcf-4177-81b1-4dc42ccfbed7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158591 Sep 13 16:23:35.684774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1010/2020] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:35.854784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:35.855426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:35.862681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:35.863192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:35.863631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:35.864328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:35.864781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:35.865210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:35.990293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:35.998379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83f2448d-2a21-481a-b75d-a5123a1ce0f7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147436 Sep 13 16:23:35.998954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1011/2021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:35 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:36.710097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:36.710707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:36.717125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:36.717606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:36.718045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:36.718730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:36.719206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:36.719631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:36.847535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:36.856020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:36.857459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:36.858616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26ced144-2064-4a17-b4b9-e4d75c28787b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152469 Sep 13 16:23:36.859212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1011/2022] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:37.021540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:37.022188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:37.028551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.029021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.029452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.030130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.030583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.031027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.158119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:37.166215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e557be34-7e89-4dcb-9251-b7c2cdd82d74 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148817 Sep 13 16:23:37.166775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1012/2023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:37 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:37.464325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:37.464828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:37.471544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.472028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.472467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.473188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.473642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.474071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.499477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:23:37.581276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05fa95b0-6e24-430c-9427-9e394947893c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 204 len: 0 microversion: 2.1 time: 0.120519 Sep 13 16:23:37.582102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1012/2024] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:23:37 2022] DELETE /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:23:37.589914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:37.590578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:37.597043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.597530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.597969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.598662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.599156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.599584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.735570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:37.743715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-888342f9-2f4a-436d-807d-34a8bc985c0a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.157613 Sep 13 16:23:37.744279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1013/2025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:37.884496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:37.885105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:37.891451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.892459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.893193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:37.893893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:37.894339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:37.894762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:38.023389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:38.032238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:38.034162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:38.035344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac81a06e-96b1-4037-a092-21f491774551 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155203 Sep 13 16:23:38.035899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1013/2026] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:38.191045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:38.191598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:38.197941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:38.198423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:38.198862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:38.199574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:38.200027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:38.200452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:38.326462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:38.334602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9eceaf36-4e2a-48a4-ab3c-f96823a3dfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148075 Sep 13 16:23:38.335210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1014/2027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:38 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:38.768169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:38.768799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:38.774788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:38.775302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:38.775752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:38.776441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:38.776895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:38.777326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:38.904406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:38.913072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0aada4cc-b30f-4b7b-9085-c790c30975a1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149405 Sep 13 16:23:38.913640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1014/2028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:39.060336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:39.060931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:39.067045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:39.067548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:39.067965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:39.068658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:39.069109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:39.069531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:39.195098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:39.203977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:39.206101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:39.207293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1336360-9c1b-4efc-a883-95d0dececd92 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151189 Sep 13 16:23:39.207844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1015/2029] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:39.357652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:39.358260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:39.364938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:39.365415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:39.365872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:39.366551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:39.367020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:39.367441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:39.498484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:39.507436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ab5de77-9a0f-414f-915f-1563a2dc6bc8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153659 Sep 13 16:23:39.507987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1015/2030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:39 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:39.936325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:39.936980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:39.943112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:39.943594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:39.944037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:39.944727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:39.945183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:39.945617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:40.072639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:40.080835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e57b4f1d-4870-4e49-8f02-b89155ac40df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148626 Sep 13 16:23:40.081395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1016/2031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:40.232739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:40.233255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:40.240037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:40.240509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:40.240940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:40.241619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:40.242065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:40.242487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:40.375451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:40.385000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:40.386434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:40.387608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b0337126-d385-4322-a2f5-86ff00b8b771 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158859 Sep 13 16:23:40.388161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1016/2032] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:40.530867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:40.531503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:40.537925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:40.538409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:40.538846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:40.539572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:40.540029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:40.540449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:40.667560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:40.676159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30c5ef7d-cbc0-47da-b0d4-17271280ef78 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149056 Sep 13 16:23:40.676724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1017/2033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:40 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:41.104366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:41.104976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:41.111509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:41.112003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:41.112432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:41.113120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:41.113568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:41.114024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:41.239123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:41.247279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f0820c1-bb95-48e4-80e2-93b3e0087945 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146731 Sep 13 16:23:41.247841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1017/2034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:41.412898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:41.413510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:41.419423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:41.419898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:41.420332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:41.421010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:41.421458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:41.421885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:41.552211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:41.560854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:41.562274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:41.563451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad431946-ba96-43b2-9437-626d725e241e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154524 Sep 13 16:23:41.564785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1018/2035] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:41.701435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:41.701973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:41.709325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:41.709804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:41.710235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:41.710957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:41.711411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:41.711848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:41.840530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:41.848691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ba16a3c-32c1-4cbe-ae5a-3d3a90e9d95b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151096 Sep 13 16:23:41.849263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1018/2036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:41 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:42.271359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:42.272073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:42.278045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:42.278477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:42.278928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:42.279649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:42.280098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:42.280521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:42.409385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:42.417535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6427117b-dedd-4d2b-a538-ccde051e4799 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150114 Sep 13 16:23:42.418102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1019/2037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:42.589311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:42.589932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:42.595902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:42.596457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:42.596892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:42.597567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:42.598011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:42.598429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:42.726132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:42.734534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:42.736027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:42.737354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8cbcbc9-1a68-4959-9631-f04e6bd0075e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151881 Sep 13 16:23:42.737899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1019/2038] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:42.871629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:42.872248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:42.879237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:42.879715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:42.880178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:42.880913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:42.881339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:42.881761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:43.008180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:43.016224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-964955cd-0b04-4ce8-9b31-701813ba895b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148394 Sep 13 16:23:43.016788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1020/2039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:42 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:43.442964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:43.443531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:43.449468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:43.449974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:43.450416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:43.451135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:43.451595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:43.452022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:43.581812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:43.589852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d6f6029-11f4-41bf-ae98-10306bda5431 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151649 Sep 13 16:23:43.590420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1020/2040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:43.762812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:43.763452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:43.769359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:43.769831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:43.770261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:43.770966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:43.771415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:43.771834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:43.899059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:43.907701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:43.909681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:43.910836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e852f9f1-182b-4a7c-9a9b-683be240c4ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151902 Sep 13 16:23:43.911581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1021/2041] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:44.040158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:44.040701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:44.047194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:44.047686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:44.048127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:44.049503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:44.049962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:44.050394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:44.179000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:44.181288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:44.188997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b41e936f-e8ea-4e4f-a57a-fcb0e35c0b50 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152761 Sep 13 16:23:44.190330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1021/2042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:44 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:44.728382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:44.729025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:44.730936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=58 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:44.736216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:44.736745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:44.737131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:44.737820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:44.738272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:44.738694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:44.868095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:44.876237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-efcaf3a2-b193-49a4-83f9-7603604e4ea9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.265828 Sep 13 16:23:44.877398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1022/2043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:44.937684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:44.938304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:44.945818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:44.946308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:44.946751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:44.947506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:44.947962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:44.948389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:45.078439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:45.087818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:45.089259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:45.090415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e76c5a6e-29bb-4b81-8203-4728b227d241 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156600 Sep 13 16:23:45.090989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1022/2044] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:45.213582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:45.214222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:45.221131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:45.221593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:45.222027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:45.222715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:45.223197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:45.223628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:45.354660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:45.362814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7452468-b264-40cb-b7fa-463327d63c6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153152 Sep 13 16:23:45.363404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1023/2045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:45 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:23:45.901165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:45.901801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:45.907734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:45.908285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:45.908661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:45.909348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:45.909801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:45.910232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:46.038750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:46.047574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ccfbb474-71e5-4669-a25d-2d8de2009f92 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150158 Sep 13 16:23:46.048143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1023/2046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:46.116682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:46.117294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:46.123221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:46.123725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:46.124156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:46.124837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:46.125284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:46.125701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:46.255313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:46.263766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:46.265205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:46.266366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1909ddb0-9017-4cc5-b7d6-c0bcdf03bb1d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153650 Sep 13 16:23:46.266937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1024/2047] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:46.385626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:46.386245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:46.392170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:46.393283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:46.393730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:46.394418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:46.394873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:46.395321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:46.523655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:46.531804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-02517548-4753-4163-bfaf-b6980152b423 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150099 Sep 13 16:23:46.532373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1024/2048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:46 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:47.071596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:47.072317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:47.078279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:47.078764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:47.079235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:47.080005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:47.081174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:47.081602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:47.212504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:47.221748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60884920-d28a-4d1b-94df-6f3a1ffc9d20 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.153875 Sep 13 16:23:47.222307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1025/2049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:47.292143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:47.292750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:47.299736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:47.300206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:47.300642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:47.301328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:47.301777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:47.302199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:47.430679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:47.439629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:47.441104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:47.442263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ad9f547-56df-462b-8f89-5722e40d4663 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154031 Sep 13 16:23:47.442874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1025/2050] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:23:47.555021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:47.555672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:47.561809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:47.562283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:47.562717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:47.563424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:47.563875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:47.564299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:47.579173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:47.692464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:47.700519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44d3221d-4cf4-4cf1-83b1-3c0ba34d4b5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149335 Sep 13 16:23:47.701077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1026/2051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:47 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:48.245191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:48.245741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:48.252167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:48.252598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:48.253055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:48.253748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:48.254205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:48.254637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:48.384908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:48.393085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-71f754dd-f4ce-42b3-944b-4ac17b5aa18c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151798 Sep 13 16:23:48.393651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1026/2052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:48.468223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:48.468856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:48.475817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:48.476291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:48.476720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:48.477401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:48.477849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:48.478271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:48.605125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:48.614237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:48.615726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:48.616878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-827ba1c4-f875-4c68-8e87-26a000451460 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152484 Sep 13 16:23:48.617432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1027/2053] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:48.724372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:48.725041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:48.731235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:48.731739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:48.732171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:48.732851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:48.733313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:48.733726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:48.864761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:48.872878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c001b016-85af-4528-a155-d76441fefca1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152912 Sep 13 16:23:48.873441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1027/2054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:48 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:49.417482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:49.418092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:49.424300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:49.424911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:49.425344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:49.426025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:49.426467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:49.426887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:49.553933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:49.562216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f75bd371-975f-4137-a14a-40bf36c9cefd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148529 Sep 13 16:23:49.562768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1028/2055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:49.642134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:49.643390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:49.649871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:49.650350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:49.650788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:49.651507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:49.651958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:49.652381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:49.777927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:49.787217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:49.788667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:49.789832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce0ab4e4-9e37-4cd5-b9da-1004f4235a8f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151601 Sep 13 16:23:49.790383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1028/2056] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:49.990144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:49.990752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:49.996585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:49.997056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:49.997486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:49.998161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:49.998604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:49.999059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:50.130341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:50.138432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a261787a-37eb-4d0c-ade7-1a4754ccfa46 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.246271 Sep 13 16:23:50.139007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1029/2057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:49 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:50.585868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:50.586468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:50.588343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:50.594202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:50.594678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:50.595140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:50.595832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:50.596276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:50.596697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:50.724450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:50.732495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f3629f3-aa98-4849-9a8a-c4b86aa2f271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150496 Sep 13 16:23:50.733047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1029/2058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:50.817116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:50.817723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:50.824064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:50.824544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:50.824982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:50.825669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:50.826118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:50.826543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:50.957376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:50.965814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:50.967281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:50.968460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1ec771e6-d6b1-4a5c-b54c-13292898156a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155729 Sep 13 16:23:50.969006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1030/2059] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:51.161630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:51.162159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:51.168321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:51.168810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:51.169036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:51.169719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:51.170166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:51.170583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:51.303092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:51.311500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eeec533d-bd62-4449-8945-67ee1f0c0f94 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153868 Sep 13 16:23:51.312056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1030/2060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:51 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:51.757202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:51.757835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:51.763856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:51.764336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:51.764776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:51.765464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:51.765916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:51.766350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:51.897206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:51.905216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-904c37cc-ea53-42b0-a472-ba58d65542bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151998 Sep 13 16:23:51.905773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1031/2061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:51.993962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:51.994639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:52.001128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:52.001610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:52.002035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:52.002829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:52.003313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:52.003732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:52.138828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:52.157044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:52.159130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:52.161616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b28209ad-ede1-43b8-adbd-b6b03324ab09 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.171241 Sep 13 16:23:52.161857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1031/2062] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:52.335798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:52.336409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:52.342381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:52.342984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:52.343421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:52.344118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:52.346005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:52.346875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:52.485639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:52.494434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2de53fae-9d01-4d4e-906c-e50e98555322 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.162368 Sep 13 16:23:52.495030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1032/2063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:52 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:52.929991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:52.930603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:52.936947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:52.937465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:52.937904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:52.938598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:52.939088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:52.939515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:53.070883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:53.079262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36c59b1d-6323-42ce-9420-a848919a6529 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.153058 Sep 13 16:23:53.079840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1032/2064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:53.187383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:53.187930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:53.194751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:53.195257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:53.195691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:53.196367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:53.196821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:53.197238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:53.324175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:53.333295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:53.334766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:53.335950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-839a32e2-63e6-4802-a16e-b549ce82ecdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152756 Sep 13 16:23:53.336505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1033/2065] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:53.517707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:53.518920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:53.524903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:53.525391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:53.525833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:53.526524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:53.527009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:53.527440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:53.657085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:53.665866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0bc17bbb-431b-4759-aadf-d984a49c262c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152112 Sep 13 16:23:53.666433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1033/2066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:53 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:54.103598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:54.104215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:54.106247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:23:54.106398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:23:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd (ip 10.222.0.50) !!! Sep 13 16:23:54.112809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:54.113294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:54.113732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:54.114424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:54.114874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:54.115322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:54.241908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:54.249954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b96fcaa6-8da3-4300-8701-c995a2e79ad8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150215 Sep 13 16:23:54.250509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1034/2067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:54.362271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:54.362881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:54.369269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:54.369751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:54.370192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:54.370887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:54.371361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:54.371786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:54.500797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:54.509484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:54.510960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:54.512115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a6ea2eb-7df1-4aee-9184-d86aeb81d91b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154337 Sep 13 16:23:54.512698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1034/2068] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:54.688775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:54.689393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:54.695525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:54.696010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:54.696449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:54.697133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:54.697586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:54.698016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:54.827019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:54.835782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f62114a3-e37d-48d3-b2e0-d6a03df0f7d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150790 Sep 13 16:23:54.836348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1035/2069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:54 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:55.273208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:55.273810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:55.280048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:55.280523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:55.280958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:55.281638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:55.282089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:55.282512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:55.413814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:55.421852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffa34c38-62a7-4ae4-851e-472344ad2669 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152498 Sep 13 16:23:55.422408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1035/2070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:55.537929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:55.538549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:55.544840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:55.545323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:55.545764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:55.546458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:55.546933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:55.547370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:55.677838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:55.686643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:55.688116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:55.689266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-edf733b4-1b01-481e-b111-f4375723f5b6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155724 Sep 13 16:23:55.689820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1036/2071] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:55.859580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:55.860188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:55.866256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:55.866736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:55.867213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:55.867899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:55.868356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:55.868781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:55.995496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:56.004181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebcfba31-d936-40bd-9035-3b7df2812996 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148458 Sep 13 16:23:56.004765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1036/2072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:55 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:56.447052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:56.447667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:56.453555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:56.454055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:56.454470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:56.455176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:56.455662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:56.456180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:56.585016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:56.593202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7257f404-d044-4641-9349-27b7bc9f0470 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150017 Sep 13 16:23:56.593770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1037/2073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:56.714789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:56.715427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:56.722249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:56.722843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:56.723309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:56.723996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:56.724444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:56.724869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:56.851485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:56.860047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:56.861496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:56.863279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34898115-cc1e-4e6b-a4cf-a0eae6975529 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152458 Sep 13 16:23:56.863836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1037/2074] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:57.027641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:57.028177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:57.034615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:57.035262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:57.035702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:57.036391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:57.036844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:57.037269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:57.163104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:57.171232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-faf390df-bd09-41e6-88db-f128fa1fc60c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147552 Sep 13 16:23:57.171795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1038/2075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:57 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:57.616825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:57.617425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:57.623599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:57.624085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:57.624523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:57.625238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:57.625688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:57.626112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:57.641755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:57.759120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:57.767269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc95ab89-eb3d-4c41-8e16-7d3923af0e22 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154204 Sep 13 16:23:57.767838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1038/2076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:57.888311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:57.888948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:57.895647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:57.896119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:57.896553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:57.897235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:57.897682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:57.898100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:58.024822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:58.033535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:58.035625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:58.036771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b25cc185-fe0b-4328-a0d5-be74ccd08ece tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152354 Sep 13 16:23:58.037322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1039/2077] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:23:58.194648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:58.195298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:58.201323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:58.201798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:58.202231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:58.202927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:58.203372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:58.203788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:58.332675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:58.340738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f9f0dd3-2557-47b0-8b14-51b35c44e3ed tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150546 Sep 13 16:23:58.341295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1039/2078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:58 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:58.797786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:58.798332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:58.804896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:58.805375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:58.805814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:58.806500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:58.806984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:58.807413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:58.935194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:58.943610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8299f8ad-74b9-4236-9c7f-62412b8416ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149670 Sep 13 16:23:58.944173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1040/2079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:59.062125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:59.062646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:59.069060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:59.069536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:59.069966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:59.070645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:59.071124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:59.071551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:59.198778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:59.207268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:59.208840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:59.210001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f0288cb-82e5-4077-aa3d-2fc6a0868c73 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152121 Sep 13 16:23:59.210551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1040/2080] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:23:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:59.362942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:59.363567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:59.369672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:59.370153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:59.370596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:59.371313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:59.371772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:59.372203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:59.501813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:23:59.510399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb4b6f16-864d-472c-b95a-09e098260392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151521 Sep 13 16:23:59.511102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1041/2081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:59 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:59.966714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:59.967296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:23:59.973642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:59.974178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:59.974611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:23:59.975314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:23:59.975794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:23:59.976217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:00.106593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:00.115261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31f18cce-b03a-4fdf-8ad6-28e02034cee6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152434 Sep 13 16:24:00.115823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1041/2082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:23:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:00.235569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:00.236091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:00.242538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:00.243082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:00.243510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:00.244237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:00.244692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:00.245118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:00.379188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:00.387622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:00.389083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:00.390225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da65c07e-cad7-40a5-9d31-8229f42f55e1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158700 Sep 13 16:24:00.390769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1042/2083] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:00.533505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:00.534044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:00.540142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:00.540619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:00.541054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:00.541735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:00.542186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:00.542611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:00.669619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:00.678319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-40235a55-74e0-47a1-af0e-5ff2eec5c7ce tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148700 Sep 13 16:24:00.679054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1042/2084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:00 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:01.139815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:01.140427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:01.146430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:01.146938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:01.147382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:01.148100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:01.148556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:01.148982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:01.152967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:01.279762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:01.288356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a167923d-eac4-4ac1-85b9-a2718b99e18b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152512 Sep 13 16:24:01.288920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1043/2085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:01.416623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:01.417227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:01.423633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:01.424109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:01.424539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:01.425215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:01.426573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:01.427177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:01.554541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:01.563333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:01.564782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:01.565938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10f99547-8fdf-405e-aafc-42a24f425cf7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153229 Sep 13 16:24:01.566671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1043/2086] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:01.702360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:01.702999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:01.710009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:01.710494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:01.710961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:01.711668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:01.712123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:01.712573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:01.840440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:01.849362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17ecf027-69a9-402c-b252-396f4b4a98f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150872 Sep 13 16:24:01.849936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1044/2087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:01 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:02.312815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:02.313421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:02.319455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:02.319871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:02.320302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:02.320972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:02.321417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:02.321835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:02.450528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:02.459556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-382addf2-2680-4996-8737-f05f94178bd4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150792 Sep 13 16:24:02.460116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1044/2088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:02.591331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:02.591945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:02.598760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:02.599297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:02.599738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:02.600430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:02.600876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:02.601308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:02.727423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:02.735796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:02.737228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:02.739520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c8ad49f-386d-4988-911a-9bade55cc501 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151572 Sep 13 16:24:02.740092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1045/2089] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:02.871590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:02.872125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:02.878061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:02.878545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:02.879017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:02.879696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:02.880142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:02.880559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:03.010446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:03.018561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-394049a6-e2e8-41b4-8f5a-861d744681d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150877 Sep 13 16:24:03.019154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1045/2090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:02 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:03.483693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:03.484223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:03.491119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:03.491593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:03.492026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:03.492705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:03.493148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:03.493566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:03.619540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:03.627622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66f8f2a9-82a8-4d31-8103-c87249b7d744 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.147826 Sep 13 16:24:03.628216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1046/2091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:03.765500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:03.766088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:03.773159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:03.773645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:03.774085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:03.774780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:03.775262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:03.775691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:03.903097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:03.912277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:03.913752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:03.914926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1f481a44-f655-4797-9aac-b57bea3012cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153433 Sep 13 16:24:03.915485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1046/2092] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:04.043053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:04.043671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:04.050008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:04.050524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:04.051328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:04.051798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:04.052245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:04.052669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:04.184635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:04.192797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98dc2a58-18bb-4b25-86ee-2af1a09dfa1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153565 Sep 13 16:24:04.193358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1047/2093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:04 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:04.651535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:04.652178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:04.658038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:04.658513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:04.658983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:04.659668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:04.660709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:04.661135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:04.785862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:04.793970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1377783-7d61-4f7a-bec6-e149e1315905 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146289 Sep 13 16:24:04.794530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1047/2094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:04.940226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:04.940840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:04.947361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:04.947842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:04.948281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:04.948961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:04.949414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:04.949838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:05.082822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:05.091744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:05.093197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:05.094339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4434760-1998-4b5b-8726-b31d41ff132a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158029 Sep 13 16:24:05.094881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1048/2095] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:05.215722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:05.216333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:05.222276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:05.222815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:05.223287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:05.223961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:05.224405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:05.224824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:05.350368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:05.359114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ba247df-7e92-47aa-af78-8766ef7af5f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147147 Sep 13 16:24:05.359685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1048/2096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:05 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:05.817726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:05.818366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:05.824330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:05.824807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:05.825245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:05.825930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:05.826379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:05.826814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:05.959528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:05.967669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-499290c6-3bed-4f0f-bd0e-94fa95e7c23c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154498 Sep 13 16:24:05.968232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1049/2097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:06.119034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:06.119638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:06.126094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:06.126572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:06.127032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:06.127719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:06.128162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:06.128581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:06.255514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:06.264005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:06.265441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:06.266586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5b38dc3-d9fb-44b0-acea-e621f1cc3a2f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151451 Sep 13 16:24:06.267187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1049/2098] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:06.382767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:06.383391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:06.389732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:06.390221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:06.390661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:06.391378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:06.391834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:06.392262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:06.516595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:06.525336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ab565bf-bd8c-4d8d-8f82-b217ef132447 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.147120 Sep 13 16:24:06.525898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1050/2099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:06 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:06.994109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:06.994719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:07.000590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:07.001061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:07.001488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:07.002163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:07.002605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:07.003049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:07.135463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:07.143594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2141b5f-0ab0-4c02-8591-c640d9af9ba5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.153313 Sep 13 16:24:07.144166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1050/2100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:07.292474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:07.293016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:07.298955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:07.299440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:07.299877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:07.300597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:07.301655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:07.302163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:07.429703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:07.438654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:07.440179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:07.441323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-908269da-89b7-412f-8ad7-685516f30981 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152819 Sep 13 16:24:07.441869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1051/2101] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:07.548954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:07.549479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:07.555410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:07.555883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:07.556315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:07.556989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:07.557433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:07.557853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:07.684832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:07.693324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1b57551-6c7f-4297-be82-a3c42ef0a1ee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148316 Sep 13 16:24:07.693882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1051/2102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:07 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:08.167293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:08.167900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:08.173793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:08.174265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:08.174696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:08.175401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:08.176470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:08.176891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:08.301834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:08.310181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef0ad6b7-0bdf-4625-9ceb-82c3f1c97cdc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146404 Sep 13 16:24:08.310750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1052/2103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:08.466564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:08.467254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:08.474407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:08.474886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:08.475368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:08.476052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:08.476502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:08.476928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:08.603035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:08.611639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:08.613095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:08.614401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e5a8fba4-4ec8-4175-80c6-1b4f80014889 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151880 Sep 13 16:24:08.615118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1052/2104] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:08.716996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:08.717606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:08.724448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:08.724926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:08.725364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:08.726044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:08.726496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:08.726937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:08.854601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:08.862625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f09dcaaf-6588-4485-ab61-2f7939c665dc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149520 Sep 13 16:24:08.863224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1053/2105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:08 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:09.334511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:09.335155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:09.341036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:09.341508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:09.341940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:09.342613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:09.343084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:09.343505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:09.469548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:09.478363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac23dda2-aa72-4446-a02e-1e423407a091 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148747 Sep 13 16:24:09.478941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1053/2106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:09.638806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:09.639467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:09.645842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:09.646323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:09.646762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:09.647476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:09.647929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:09.648354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:09.778038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:09.786676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:09.788242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:09.789410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-377eb08f-686e-43f6-a9ad-32a2465ec183 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154515 Sep 13 16:24:09.789965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1054/2107] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:09.886240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:09.886927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:09.893048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:09.893470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:09.893912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:09.894622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:09.895227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:09.895504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:10.019485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:10.027633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f9ba7e1-e32e-467d-b94a-f07dc561a44f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.145226 Sep 13 16:24:10.028200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1054/2108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:09 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:10.501618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:10.502187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:10.508291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:10.508768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:10.509204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:10.509888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:10.510372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:10.510799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:10.638226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:10.646844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c67794d3-f78c-40f5-9024-1ad5d2b3b159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149144 Sep 13 16:24:10.647445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1055/2109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:10.815101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:10.815627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:10.822545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:10.823055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:10.823490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:10.824167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:10.824613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:10.825029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:10.827548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:10.954346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:10.963593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:10.965062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:10.966211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd5db4ec-e023-4a8c-9513-f96083f20cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155078 Sep 13 16:24:10.966766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1055/2110] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:11.050656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:11.051504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:11.059210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:11.059704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:11.060405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:11.061110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:11.061569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:11.062001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:11.190660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:11.199367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26d9e084-fc0e-49e0-a228-555eaff2586a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152752 Sep 13 16:24:11.199926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1056/2111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:11 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:11.670638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:11.671284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:11.677413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:11.677896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:11.678339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:11.679061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:11.679518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:11.679943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:11.808530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:11.816893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bcf694d0-8e84-4c4c-9877-01c45a6f4438 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150034 Sep 13 16:24:11.817547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1056/2112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:11.991001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:11.991558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:11.997501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:11.997981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:11.998419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:11.999137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:11.999591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.000019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.127370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:12.136580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:12.138067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:12.139243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0b7ff9d-0d74-40c9-ac0c-696274e96556 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152236 Sep 13 16:24:12.139798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1057/2113] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:12.222824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:12.223472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:12.229854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.230336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.230776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.231498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.231951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.232378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.368648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:12.376880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-60ab9680-a5aa-4274-ab1e-c07f3d187383 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.158009 Sep 13 16:24:12.377447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1057/2114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:12 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:12.482443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:12.491513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:12.498095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.498597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.499071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.499786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.500240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.500694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.528988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:24:12.561655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:12.604658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a782ea6-f33f-4a29-b3f5-0e0aa76b4fbf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 204 len: 0 microversion: 2.1 time: 0.125686 Sep 13 16:24:12.605313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1058/2115] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:24:12 2022] DELETE /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:24:12.614628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:12.615329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:12.621241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.621715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.622147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.622822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.623306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.623722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.750490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:12.758851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-77b77eaf-73c4-4ca3-9ccd-b07a2149aff0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149064 Sep 13 16:24:12.759435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1058/2116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:12.841826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:12.842546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:12.849207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.849683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.850117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.850800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:12.851267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:12.851693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:12.978540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:12.986565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eccef9e4-9499-4c0d-a7bd-19c204943b48 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149297 Sep 13 16:24:12.987154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1059/2117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:13.165855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:13.166469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:13.172554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:13.173037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:13.173479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:13.174164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:13.174616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:13.175075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:13.306009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:13.314944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:13.316400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:13.318401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94959670-3a70-48e0-b8fd-8deab3ca2169 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156489 Sep 13 16:24:13.318981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1059/2118] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:13.399852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:13.400462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:13.406727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:13.407235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:13.407685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:13.408352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:13.408797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:13.409216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:13.537260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:13.546016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1b1d5af-bc8f-4b14-b589-03f1275c6e6d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149983 Sep 13 16:24:13.546675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1060/2119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:13 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:13.782396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:13.782953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:13.789504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:13.789986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:13.790420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:13.791162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:13.791614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:13.792043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:13.921343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:13.929551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45a9c8a1-caf0-49cb-9f90-8fc99997d104 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151051 Sep 13 16:24:13.930108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1060/2120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:14.011234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:14.011849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:14.017725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.018200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.018636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.019364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.020424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.020857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.146043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:14.154134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a314e6b0-e485-47e4-a30b-965701a73342 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146758 Sep 13 16:24:14.154696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1061/2121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:14.344011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:14.344615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:14.350892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.351389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.351819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.352493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.352934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.353351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.482069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:14.491079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:14.492510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:14.493654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9249a7d8-43be-4963-b7f4-16f3b9ffb994 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153496 Sep 13 16:24:14.494197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1061/2122] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:14.570257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:14.570987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:14.577656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.578146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.578584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.579302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.579774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.580201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.705872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:14.713980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4877fc7a-f178-4422-ad16-97d702a8ef8e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148311 Sep 13 16:24:14.714536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1062/2123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:14 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:14.953104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:14.953634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:14.959597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.960079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.960519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:14.961205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:14.961654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:14.962078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.090094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:15.098229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d257a021-a4d7-4527-92f8-17657ea14d22 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149076 Sep 13 16:24:15.098794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1062/2124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:15.177917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:15.178537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:15.180523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:15.186145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:15.186630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:15.187098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.187790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:15.188245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:15.188673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.519205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:15.519844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:15.527397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:15.527904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:15.528356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.529055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:15.529511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:15.529965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.544101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:15.552179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef33e045-5cdd-407e-b9e3-969168090469 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.378572 Sep 13 16:24:15.552745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1063/2125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:15.658065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:15.667371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:15.668818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:15.670029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b67d9fd-3eb2-436a-9ee2-555b5f4849bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154756 Sep 13 16:24:15.670571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1063/2126] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:15.737449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:15.738062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:15.745334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:15.745755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:15.746195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.746873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:15.747380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:15.747803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:15.883929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:15.891947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36f81800-082a-4f8c-ad51-8a2dda4e66ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.158346 Sep 13 16:24:15.892507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1064/2127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:15 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:16.120584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:16.121202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:16.127191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.127675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.128116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.128802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.129723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.130566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.254712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:16.262949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ea66987-8878-4d79-9148-7bb66bfcc5e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146206 Sep 13 16:24:16.263516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1064/2128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:16.576561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:16.577163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:16.583695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.584168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.584598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.585276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.585720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.586166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.695711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:16.696324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:16.702347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.702825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.703297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.703988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.704432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.704857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.718268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:16.727642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93d6a3f0-eded-48cb-b64b-8f66706d56f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154750 Sep 13 16:24:16.735166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1065/2129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:16.834306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:16.842746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:16.844201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:16.845345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3fc172a7-a1d4-4fce-9c94-1beb4f1c4a69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154199 Sep 13 16:24:16.845889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1065/2130] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:16.915710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:16.916326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:16.922641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.923161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.923603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:16.924286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:16.924737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:16.925162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.049910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:17.058853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b40380d9-7f6c-4bb9-a939-71f0674d9729 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.146960 Sep 13 16:24:17.059439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1066/2131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:16 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:17.287391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:17.287943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:17.293955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:17.294436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:17.294876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.295585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:17.296043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:17.296475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.426372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:17.434958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65781438-a0a0-4f3d-a95c-a27eda9f63ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152077 Sep 13 16:24:17.436275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1066/2132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:17.752547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:17.753196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:17.760046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:17.760536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:17.760978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.761668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:17.762121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:17.762549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.870508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:17.871274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:17.877593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:17.878074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:17.878512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.879233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:17.879740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:17.880162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:17.891194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:17.899482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-890876d4-8166-4bf4-bfb6-c51e2635f7e6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150772 Sep 13 16:24:17.900044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1067/2133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:18.011993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:18.021245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:18.022696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:18.023897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d494445e-4830-4953-94cd-172faa8f5456 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.157358 Sep 13 16:24:18.024452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1067/2134] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:18.081717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:18.082332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:18.089349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:18.089832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:18.090272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:18.090983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:18.091440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:18.091863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:18.218323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:18.227373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-906c716b-6589-4de0-9044-2b1eea5dc2f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149409 Sep 13 16:24:18.227925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1068/2135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:18 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:18.459107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:18.459713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:18.465593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:18.466101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:18.466535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:18.467242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:18.467689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:18.468109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:18.594231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:18.602942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa7b8605-9cd3-4314-b948-c2203d6e3e17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147826 Sep 13 16:24:18.603488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1068/2136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:18.924055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:18.924825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:18.932907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:18.933877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:18.934598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:18.935371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:18.936159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:18.936609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.049893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:19.050597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:19.057450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:19.057936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:19.058380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.059110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:19.059564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:19.059991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.067845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:19.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9bfc5122-fbeb-4623-9534-ddeb404dab6a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.155723 Sep 13 16:24:19.076519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1069/2137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:19.188889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:19.198441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:19.199986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:19.201137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7244782-0633-4462-90c5-2ad0f9559bc6 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155328 Sep 13 16:24:19.201686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1069/2138] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:19.251445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:19.252054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:19.259015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:19.259494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:19.259928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.260619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:19.261068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:19.261484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.390600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:19.399730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3275b3e-5a4d-4ebe-abf8-aa39c463cdba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152089 Sep 13 16:24:19.400291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1070/2139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:19 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:19.626704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:19.627304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:19.633193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:19.633677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:19.634118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.634808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:19.635291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:19.635723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:19.761544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:19.769672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e555ae27-88a3-44c5-82a9-c5752114d2af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146961 Sep 13 16:24:19.770235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1070/2140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:20.100077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:20.100684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:20.106642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.107149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.107584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.108258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.108705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.109124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.227074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:20.227813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:20.234097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.234579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.235120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.235812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.236267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.236689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.238679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:20.246972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48490b79-9245-4697-90ab-cd6b66c7c7f9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150757 Sep 13 16:24:20.247548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1071/2141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:20.365140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:20.367609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:20.375570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:20.377004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:20.378144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8db8b4fa-711f-4852-9d91-4ac5785f15cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155112 Sep 13 16:24:20.378689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1071/2142] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:20.423442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:20.424112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:20.431234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.431721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.432164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.432854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.433313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.433744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.561074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:20.569639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eacb72bb-faba-4a7e-a368-839453fc3cec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150053 Sep 13 16:24:20.570281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1072/2143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:20 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:20.793370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:20.793901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:20.795773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:20.801370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.801939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.803063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.803748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:20.804200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:20.804624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:20.934765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:20.943558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49080404-622d-410b-ba5e-849d19446657 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154101 Sep 13 16:24:20.944222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1072/2144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:21.272376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:21.272983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:21.278935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.279411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.279844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.280523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.280966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.281381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.404717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:21.405417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:21.408498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:21.412085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.412665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.413098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.413829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.414282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.414702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.416702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14f62f29-5fb2-499a-aa34-59f4a4cd196e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149091 Sep 13 16:24:21.417267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1073/2145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:21.548180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:21.557077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:21.558497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:21.559661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3cd5cd22-380b-477f-9cd5-4bd37c64bdea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158929 Sep 13 16:24:21.560217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1073/2146] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:21.593002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:21.593637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:21.600614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.601100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.601541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.602232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.602686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.603153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.730434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:21.732645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:21.740468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aacc9ab7-9dcb-4a69-9784-eba3b14cf71a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151260 Sep 13 16:24:21.741039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1074/2147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:21 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:21.968169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:21.968688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:21.974723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.975230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.975665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:21.976341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:21.976785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:21.977205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.107800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:22.116467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7394154c-d2c4-46e8-95c1-ab3416c6fb9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152253 Sep 13 16:24:22.117025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1074/2148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:22.440972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:22.441721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:22.448409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:22.448885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:22.449318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.449999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:22.450442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:22.450859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.580926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:22.586133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:22.586750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:22.590200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-356cd6c0-b461-4821-851d-6319c615f7dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.153378 Sep 13 16:24:22.590846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1075/2149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:22.593240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:22.593722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:22.594170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.594862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:22.595340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:22.595770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.722453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:22.732257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:22.733699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:22.734865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83317304-be1a-48a9-92ad-987e286e86c7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153271 Sep 13 16:24:22.735448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1075/2150] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:22.764824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:22.765440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:22.772593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:22.773073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:22.773507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.774198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:22.774649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:22.775103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:22.912846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:22.922676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-594145db-9fa5-4b5c-a39b-772adcb8f04e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.162367 Sep 13 16:24:22.923275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1076/2151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:22 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:23.140213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:23.140856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:23.147644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.148128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.148573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.149260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.149715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.150143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.277193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:23.285284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-263dccf7-1ca7-40bb-aeb0-b57caa15996b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148917 Sep 13 16:24:23.285868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1076/2152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:23.615088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:23.615703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:23.621642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.622114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.622581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.623287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.623739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.624165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.752965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:23.761188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8605f2f1-f889-4691-83a4-bd76bed4a563 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150484 Sep 13 16:24:23.761369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:23.761807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1077/2153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:23.761906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:23.768348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.768823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.769255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.769932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.770380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.771230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.899650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:23.908186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:23.909622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:23.910775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67735098-21b5-49d5-bb60-eb5844318411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153446 Sep 13 16:24:23.911870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1077/2154] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:23.946300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:23.946936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:23.953270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.953752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.954198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:23.954887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:23.955369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:23.955797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:24.082579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:24.091673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0322fa41-1a47-48f0-9068-d1a177357c23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149552 Sep 13 16:24:24.092234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1078/2155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:23 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:24.308419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:24.308960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:24.315166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:24.315651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:24.316088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:24.316769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:24.317220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:24.317718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:24.448545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:24.456737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9bd44d9a-a5d8-4261-8237-59c5890091fa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152169 Sep 13 16:24:24.457306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1078/2156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:24.784534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:24.785166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:24.791406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:24.791886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:24.792323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:24.793002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:24.793448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:24.793865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:24.922573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:24.931320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cfb7908-bf41-4b23-8d9d-e174bc7e22c5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150590 Sep 13 16:24:24.931877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1079/2157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:24.937574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:24.938182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:24.945345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:24.945831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:24.946271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:24.947005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:24.947462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:24.947890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:25.078245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:25.086992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:25.088437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:25.089587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6fe674d9-631b-43fc-aa1f-c9fc9901d400 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156121 Sep 13 16:24:25.090135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1079/2158] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:25.115812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:25.116427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:25.122724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:25.123239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:25.123673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:25.124348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:25.124793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:25.125212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:25.256165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:25.264411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8300cb77-2423-44b5-a60b-89e555e23bc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.153190 Sep 13 16:24:25.264965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1080/2159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:25.481132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:25.481786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:25.487802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:25.488288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:25.488732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:25.489421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:25.490527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:25.490986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:25.617525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:25.625579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1cd7f420-7618-40b5-89e2-a74c9ddd5eee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148290 Sep 13 16:24:25.626142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1080/2160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:25.955739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:25.956354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:25.963091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:25.963571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:25.964007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:25.964694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:25.965147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:25.965568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.094260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:26.102457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af5b23aa-d4a3-4238-8183-c0a35ad7b319 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150574 Sep 13 16:24:26.103033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1081/2161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:26.115100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:26.115825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:26.122302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:26.122786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:26.123256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.123945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:26.124402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:26.124832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.253085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:26.262205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:26.263693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:26.264846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3ac60ef-283d-4ce5-ad13-11d197ea9f46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153712 Sep 13 16:24:26.265386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1081/2162] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:26.287063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:26.287678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:26.294094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:26.294571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:26.295041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.295726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:26.296177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:26.296599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.423976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:26.432673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c312f855-ead4-46f0-82b8-feb890eb77c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149568 Sep 13 16:24:26.433281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1082/2163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:26 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:26.648723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:26.649353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:26.655195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:26.655670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:26.656100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.656776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:26.657221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:26.657639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:26.786234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:26.795064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00d085b0-d5cf-42ee-9159-aa71b79a39c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150408 Sep 13 16:24:26.795628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1082/2164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:27.126200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:27.126821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:27.132886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.133373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.133822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.134512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.135026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.135459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.275001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:27.283259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b2f13f30-9c7f-482d-9b99-f65c3c504d77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.160852 Sep 13 16:24:27.283796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1083/2165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:27.293862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:27.294616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:27.301272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.301762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.302236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.302963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.303414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.303844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.431240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:27.440218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:27.441653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:27.443401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0539203f-a5e2-4499-99a5-8cd3385957f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154268 Sep 13 16:24:27.443977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1083/2166] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:27.456179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:27.456793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:27.463733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.464237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.464658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.465347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.465803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.466230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.593219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:27.601307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21d9745d-2854-47cc-8b57-374d9a30a3f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148947 Sep 13 16:24:27.601869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1084/2167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:27 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:27.819822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:27.820426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:27.826443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.826945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.827382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.828060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:27.828513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:27.828931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:27.961611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:27.969981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e384c4ce-a733-4411-8df2-ee7ad66d1bf9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154755 Sep 13 16:24:27.970926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1084/2168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:28.308900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:28.309434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:28.315782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:28.316268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:28.316706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:28.317390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:28.318080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:28.318628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:28.447455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:28.455456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e356bb57-4ca3-4c99-ae91-d3f29354578f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150528 Sep 13 16:24:28.456014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1085/2169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:28.469513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:28.470126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:28.477261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:28.477746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:28.478188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:28.478879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:28.479359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:28.479789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:28.611192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:28.620016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:28.621452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:28.622625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2ce8df5-7ae4-40ef-8840-386a67c02467 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.157058 Sep 13 16:24:28.623192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1085/2170] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:28.623712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:28.624331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:28.630969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:28.631555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:28.631996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:28.632695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:28.633151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:28.633580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:28.760585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:28.768709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-518e74f1-c11a-45e0-96c6-8b3f475b6501 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148787 Sep 13 16:24:28.769265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1086/2171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:28 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:28.993572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:28.994148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:29.000059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.000538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.000973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.001650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.002100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.002521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.130017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:29.138624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-025eeb0c-f45b-4810-b697-a7b3ecae824d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149039 Sep 13 16:24:29.139229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1086/2172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:29.479095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:29.479725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:29.485855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.486339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.486781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.487500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.487957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.488386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.619841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:29.627963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f53b8fbc-4a7c-49b4-91ee-5a5e3269dbfd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152689 Sep 13 16:24:29.628537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1087/2173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:29.647892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:29.648501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:29.654892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.655353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.655797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.656483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.656937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.657365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.785499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:29.792558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:29.793171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:29.794624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:29.796084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:29.797234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d094ecd-76f6-4019-96d3-6bd6967818e3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153188 Sep 13 16:24:29.797787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1087/2174] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:29.799042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.799530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.799969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.800656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:29.801108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:29.801536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:29.931170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:29.939743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16e4195d-3324-4dc5-b5aa-2295a04ccd4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150947 Sep 13 16:24:29.940309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1088/2175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:29 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:30.161366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:30.163000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:30.168872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.169344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.169772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.170459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.170891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.171334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.186031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:30.297876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:30.306407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48ba9bfe-d264-4ab6-97c5-ca2dd920a444 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148930 Sep 13 16:24:30.306989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1088/2176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:30.652684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:30.653289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:30.659769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.660244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.660678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.661352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.662012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.662463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.791452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:30.799514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7372e10-8c32-45e6-8396-26a31f6217d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150595 Sep 13 16:24:30.800068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1089/2177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:30.824463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:30.825100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:30.831387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.831860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.832295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.833014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.833504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.834262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.962011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:30.963318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:30.963938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:30.969607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.970082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.970513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.970862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:30.971224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:30.971669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:30.972112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:30.972317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:30.973457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-302781e0-6378-4c5d-b503-d24fe0c2fd16 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152874 Sep 13 16:24:30.974002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1089/2178] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:31.102093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:31.110687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd110d3a-81b4-4f45-8280-be84bac3bebd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151489 Sep 13 16:24:31.111269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1090/2179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:31.329488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:31.330098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:31.336138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:31.336621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:31.337062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:31.337770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:31.338217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:31.338638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:31.469123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:31.478036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2a5947f-3936-44ac-8c09-b1b4ee80c02b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152343 Sep 13 16:24:31.478595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1090/2180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:31.824270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:31.825011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:31.831441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:31.831923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:31.832360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:31.833048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:31.834018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:31.834448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:31.849834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:31.962603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:31.970787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07a750e5-1083-4f10-9c1b-8100b454d2f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150373 Sep 13 16:24:31.971380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1091/2181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:31.999266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:31.999916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:32.006404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:32.006882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:32.007347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:32.008032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:32.008482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:32.008906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:32.136164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:32.136853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:32.142478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:32.143238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:32.143730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:32.144168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:32.145044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:32.145511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:32.145989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:32.151133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:32.152569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:32.153712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a504652-fd95-42fc-97ea-a61df3a603b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158315 Sep 13 16:24:32.154258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1091/2182] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:32.274483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:32.282571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-763972a1-466f-4be7-b571-3da9e6a91192 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151115 Sep 13 16:24:32.283165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1092/2183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:32.501494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:32.502112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:32.508184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:32.508671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:32.509108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:32.509793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:32.510246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:32.510676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:32.639642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:32.647998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3511a43a-c9db-4817-90fa-91a271fd575d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150358 Sep 13 16:24:32.648557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1092/2184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:32.995406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:32.996021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:33.002382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.002867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.003338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.004023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.004475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.004917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.135645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:33.143741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa9291d4-9bcd-4a97-ab0c-3d8e3d901a55 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152112 Sep 13 16:24:33.144300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1093/2185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:33.180300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:33.180920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:33.187559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.188030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.188462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.189136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.189611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.190027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.305928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:33.306545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:33.312753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.313356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.313827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.314529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.315063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.315602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.317007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:33.326536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:33.328132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:33.329382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb0f98e8-7b87-4a50-9f67-1d76103dc110 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153776 Sep 13 16:24:33.329949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1093/2186] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:33.445245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:33.453328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-794767ef-93c2-47d9-9515-6690ae12ed93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151671 Sep 13 16:24:33.453887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1094/2187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:33 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:33.672174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:33.672768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:33.679387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.679874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.680313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.681003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:33.681456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:33.681884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:33.807843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:33.816189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f426be0-c540-48fd-b4a1-2ffce4a0a9fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148264 Sep 13 16:24:33.816753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1094/2188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:34.167775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:34.168379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:34.174703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.175208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.175637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.176313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.176757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.177181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.306093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:34.314512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62633333-dc3d-43f1-a395-0c90ca226d65 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150520 Sep 13 16:24:34.315108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1095/2189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:34.355837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:34.356466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:34.362781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.363281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.363710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.364384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.364855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.365770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.476989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:34.477604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:34.483595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.484073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.484505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.485186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.485638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.486055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.494739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:34.503449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:34.505035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:34.506757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce178c81-c0cd-4bdf-bb19-bc441c404381 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155124 Sep 13 16:24:34.507354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1095/2190] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:34.618752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:34.626847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-394b4f17-aa69-4d20-b079-983c02984ba4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.154300 Sep 13 16:24:34.627433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1096/2191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:34 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:34.839457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:34.840069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:34.845968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.846448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.846884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.847585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:34.848035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:34.848459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:34.977435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:34.985466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-62c00971-7a03-4b07-8944-35f4ffdb5569 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149883 Sep 13 16:24:34.986030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1096/2192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:35.339356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:35.339966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:35.346271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:35.346748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:35.347230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:35.347914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:35.348365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:35.348793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:35.474782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:35.483653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d523dce4-b011-4620-b301-59d7d39d30fa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148312 Sep 13 16:24:35.484220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1097/2193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:35.532478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:35.533091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:35.540431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:35.540917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:35.541354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:35.542050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:35.542506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:35.542953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:35.651642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:35.652451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:35.658236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:35.658717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:35.659198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:35.659888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:35.660337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:35.660759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:35.675310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:35.684588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:35.686025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:35.687463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-613ae323-da83-4884-8ada-8624da09091e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158573 Sep 13 16:24:35.688017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1097/2194] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:35.787093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:35.796086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8fcfd14c-52de-44d7-babc-7d0a7648efec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149225 Sep 13 16:24:35.796644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1098/2195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:35 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:36.009229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:36.009767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:36.015672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.016149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.016584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.017264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.017711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.018132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.143679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:36.152575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9a0e427-337c-4ed4-8dc6-ce2037152780 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147437 Sep 13 16:24:36.153143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1098/2196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:36.507626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:36.508237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:36.514629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.515170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.515605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.516289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.516738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.517162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.645601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:36.654273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e38e1d8-915d-4f72-8740-9d856f3e84be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151074 Sep 13 16:24:36.654841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1099/2197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:36.714403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:36.715068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:36.721355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.721827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.722259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.722955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.723404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.723823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.819918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:36.820740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:36.826617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.827203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.827711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.828470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:36.829006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:36.829461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:36.857476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:36.866197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:36.867863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:36.869026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-79d637fb-84cf-4fa8-a0d7-0ccd9e27647d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.159487 Sep 13 16:24:36.869735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1099/2198] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:36.962750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:36.970799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5eed3d26-89a8-44b2-b611-508e505318f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.155071 Sep 13 16:24:36.971385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1100/2199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:36 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:37.176029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:37.176733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:37.183983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:37.184462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:37.184897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:37.185582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:37.186033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:37.186454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:37.311291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:37.319684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e030a7a-e9d7-4122-9724-2ee6d3511dd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147412 Sep 13 16:24:37.320200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1100/2200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:37.678325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:37.678978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:37.685603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:37.686084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:37.686522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:37.687512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:37.687965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:37.688389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:37.816772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:37.825116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4d33e9eb-95f5-4506-9dbe-a56de6715d18 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150712 Sep 13 16:24:37.825680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1101/2201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:37.894548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:37.895282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:37.902381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:37.902870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:37.903351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:37.904041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:37.904492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:37.904924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:37.994655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:37.995351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:38.001263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:38.001745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:38.002182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:38.002872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:38.003369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:38.003775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:38.037538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:38.047534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:38.048626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:38.049814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05c237a6-fa95-4be8-945e-d8766b158e14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.159144 Sep 13 16:24:38.050379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1101/2202] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:38.133230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:38.141366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2f0040c-6b50-43b8-8123-5ff244abb3ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150514 Sep 13 16:24:38.141921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1102/2203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:37 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:38.342456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:38.343094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:38.348992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:38.349471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:38.349906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:38.350859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:38.351189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:38.351619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:38.480646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:38.488783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b634c00-da1e-4def-9e46-1d72df366478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150086 Sep 13 16:24:38.489348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1102/2204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:38.850039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:38.850768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:38.857137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:38.857615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:38.858051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:38.858734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:38.859212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:38.859637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:38.993233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:39.001426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43b79ec8-cccc-4127-a326-f04d0aca935b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.155291 Sep 13 16:24:39.001983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1103/2205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:39.076348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:39.076961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:39.083364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:39.083868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:39.084305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:39.085036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:39.085486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:39.085912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:39.165172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:39.165698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:39.171761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:39.172239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:39.172675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:39.173363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:39.173815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:39.174242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:39.230634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:39.239411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:39.241474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:39.242830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-79a72c10-5f69-4884-8194-f363836b3c49 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.170383 Sep 13 16:24:39.243431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1103/2206] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:39.311827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:39.320902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14f1d749-29b3-4d94-a3bc-806c8058a170 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.159734 Sep 13 16:24:39.321450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1104/2207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:39 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:39.511125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:39.511650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:39.517709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:39.518185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:39.518617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:39.519325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:39.519778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:39.520197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:39.645867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:39.654390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-423a0793-8f2d-4261-a4f4-1aa21aa99b11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147356 Sep 13 16:24:39.654967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1104/2208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:40.026167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:40.027232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:40.033624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.034107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.034576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.035299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.035751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.036176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.165120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:40.173091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27439feb-5e3e-4b4f-89a5-33e6a052c4f2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151396 Sep 13 16:24:40.173644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1105/2209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:40.268965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:40.269538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:40.275604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.276088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.276537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.277227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.277682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.278112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.280674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:40.343687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:40.344381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:40.350171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.351299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.351975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.352737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.353248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.353736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.438861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:40.448076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:40.449515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:40.450673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5699d928-dd0e-4cbd-85ed-b9e7c33420be tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.185699 Sep 13 16:24:40.451248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1105/2210] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:40.499800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:40.507985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92adf7f6-bfd4-4ccc-9034-3517f02d0902 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.168496 Sep 13 16:24:40.508540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1106/2211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:40 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:40.678020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:40.678623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:40.685472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.685948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.686380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.687094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:40.687797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:40.688215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:40.816353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:40.824970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4d7f8dd-6d62-4bd0-8354-f071f37aec3d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150748 Sep 13 16:24:40.825526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1106/2212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:41.198258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:41.198870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:41.206498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.207310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.207750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.208442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.208894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.209328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.340592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:41.348717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a37f2ad3-c198-4531-9f9d-54bc216a6fe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154811 Sep 13 16:24:41.349277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1107/2213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:41.476045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:41.476652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:41.482669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.483181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.483622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.484308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.484764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.485192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.531399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:41.532003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:41.537790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.538440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.539384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.540070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.540520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.540941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.544869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:41.650970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:41.659633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:41.661085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:41.662242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd1c08e0-5bab-4b03-8e01-fb2602f318a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.190115 Sep 13 16:24:41.662805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1107/2214] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:41.696229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:41.704563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-398ce7e9-1195-4f6e-9ea6-c4d00ef0adca tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.176940 Sep 13 16:24:41.705144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1108/2215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:41 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:41.847778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:41.848425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:41.854979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.855457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.855892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.856574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:41.857025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:41.857448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:41.990191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:41.998877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcb3b6c2-d00d-4341-8fd6-928def7142a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154924 Sep 13 16:24:41.999457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1108/2216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:42.373306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:42.373951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:42.380461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:42.380941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:42.381377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:42.382115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:42.382564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:42.383026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:42.508119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:42.516230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a110520-1f3e-4e1e-bc9f-9e6ca1b4fd64 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146776 Sep 13 16:24:42.516792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1109/2217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:42.689373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:42.689903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:42.695923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:42.696401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:42.696833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:42.697520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:42.697969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:42.698393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:42.727615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:42.728234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:42.734425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:42.734935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:42.735405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:42.736101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:42.736582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:42.737008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:42.876730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:42.886562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:42.888128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:42.889355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b94c9f25-2ab5-4b02-be17-c6e798d4de25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.204170 Sep 13 16:24:42.889993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1109/2218] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:42.902258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:42.910630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5260279-0096-48ce-b02d-acadf83bb799 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.187511 Sep 13 16:24:42.911226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1110/2219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:42 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:43.023224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:43.023760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:43.029907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.030389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.030821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.031522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.031969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.032389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.165350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:43.173430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-acf92975-3781-4d78-abdc-4df60920283a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154032 Sep 13 16:24:43.173983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1110/2220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:43.539301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:43.539975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:43.546410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.546893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.547365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.548053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.548507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.548933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.675149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:43.683255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebcd3d54-2843-43a2-aa5e-e99bfd363186 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148326 Sep 13 16:24:43.683821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1111/2221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:43.915741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:43.916468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:43.922806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.923311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.923743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.924416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.924859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.925277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.933636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:43.934253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:43.940458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.940966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.941401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:43.942081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:43.942529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:43.942986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:44.117383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:44.126746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:44.128226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:44.128375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:44.129387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49e405e1-0bcb-431d-bee3-e6d7004bd8d4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218319 Sep 13 16:24:44.129956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1111/2222] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:44.137629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f5d9116-f116-4a3d-b88a-fde7eb53b9fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.207782 Sep 13 16:24:44.138185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1112/2223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:43 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:44.198357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:44.198893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:44.204823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:44.205298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:44.205732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:44.206407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:44.206854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:44.207299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:44.336484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:44.344659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc7e5c54-d400-4eb8-922c-3aff7a98dbb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151159 Sep 13 16:24:44.345221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1112/2224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:44.707165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:44.707774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:44.710110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:44.715306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:44.715791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:44.716227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:44.716913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:44.717364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:44.717784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.071321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:45.079464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-800fcaee-e728-4e14-9040-5791c57a3a17 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.376212 Sep 13 16:24:45.080020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1113/2225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:45.154882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:45.155596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:45.160380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:45.160997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:45.162202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:45.162673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:45.163129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.163900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:45.164346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:45.164766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.166792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:45.167314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:45.167753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.168445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:45.168900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:45.169332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.358606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:45.361646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:45.367944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:45.369454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:45.370104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7240cc4-78e5-48fd-8c38-2092a40580cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213430 Sep 13 16:24:45.370608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7193c80b-2225-4fbf-812c-ff6f2d2b8227 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.219745 Sep 13 16:24:45.370733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1114/2226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:45 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:45.373826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1113/2227] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:45.375211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:45.375821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:45.381417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:45.381902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:45.383156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.383864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:45.384318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:45.384752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:45.510414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:45.518583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0fdaefa9-ac81-4fbc-8c30-91608c014ed9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146959 Sep 13 16:24:45.519184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1115/2228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:46.104615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:46.105221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:46.111194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.111673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.112109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.112821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.113270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.113695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.244446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:46.252558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-125559e0-5ebc-4ddf-aa20-8b4ce4b2cfb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152548 Sep 13 16:24:46.253121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1114/2229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:46.393558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:46.394248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:46.400921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.404512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.405049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.405911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.406254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:46.406373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.406803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.407039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:46.412946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.413475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.413998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.414686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.415159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.415578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.601460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:46.608866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:46.609653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b86496db-1bf2-460e-8592-7513faad9e21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219959 Sep 13 16:24:46.610223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1116/2230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:46 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:46.614604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:46.615259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:46.618356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:46.619846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:46.620856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.621059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f568024b-434b-4eb3-b25a-3d6300401ce3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218516 Sep 13 16:24:46.621340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.621558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1115/2231] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:46.621888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.622758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:46.623405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:46.623819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:46.751263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:46.759832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e541edfb-c992-4fe3-a20f-db219617328f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148682 Sep 13 16:24:46.760389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1117/2232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:47.276732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:47.277356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:47.283839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.284325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.284765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.285450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.285904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.286331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.415842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:47.424163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd084ea8-844a-4283-8106-2e0fc5f3815b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151328 Sep 13 16:24:47.424894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1116/2233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:47.633179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:47.633726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:47.640060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.640546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.640987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.641677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.642130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.642561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.647315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:47.648441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:47.654325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.654803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.655286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.655976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.656429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.656862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.830334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:47.839061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d096228a-00c3-4b7e-a232-8c852b244952 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.209898 Sep 13 16:24:47.839625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1118/2234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:47 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:47.841881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:47.844011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:47.844580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:47.850315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.850634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:47.850873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.852073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.852796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:47.853322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:47.853461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:47.853886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:47.854552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8382baa8-0d92-4f7d-b4c7-cbe06c6aa0ef tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211139 Sep 13 16:24:47.855319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1117/2235] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:47.984249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:47.992972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30a7d358-9e0b-492d-82e7-76e4914aa778 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152414 Sep 13 16:24:47.993526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1119/2236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:48.448450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:48.449084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:48.455400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:48.455871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:48.456303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:48.456981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:48.457426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:48.457845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:48.588136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:48.596200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a53c0633-8ea4-47ee-bd45-50beb85b2234 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151967 Sep 13 16:24:48.596754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1118/2237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:48.862876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:48.863511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:48.869854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:48.870327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:48.870759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:48.871468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:48.871918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:48.872339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:48.879220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:48.879858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:48.886535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:48.887054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:48.887502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:48.888192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:48.888642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:48.889065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:49.072054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:49.076201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:49.080175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78170343-f1de-4084-a1d9-6584d981aa35 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.221155 Sep 13 16:24:49.080738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1120/2238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:48 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:49.085077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:49.085213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:49.086289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:49.087882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:49.089289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3287faf-4f78-4b0b-8d4c-9b0f75c4d1c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213978 Sep 13 16:24:49.089954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1119/2239] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:49.092074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:49.092550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:49.092978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:49.093656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:49.094102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:49.094523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:49.225650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:49.235357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cf42b6d-5601-4817-a375-317464941e05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153657 Sep 13 16:24:49.235916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1121/2240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:49.621231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:49.621837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:49.628229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:49.628711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:49.629142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:49.629817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:49.630266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:49.630684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:49.758004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:49.766109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3942795c-f469-41bb-8938-e23b854d2e43 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148728 Sep 13 16:24:49.766683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1120/2241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:50.104710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:50.105331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:50.112085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.112589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.113020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.113701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.114146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.114566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.114828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:50.115474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:50.121969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.122446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.122878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.123586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.124036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.124460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.306040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:50.311927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:50.314445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:50.314748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4669818d-04f1-49cd-9964-77f71edb7a1e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214617 Sep 13 16:24:50.316002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1122/2242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:50 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:50.321153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:50.321756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:50.321861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:50.323312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:50.324571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-914075f2-10cf-4a92-a9c8-eb234168f7ab tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213330 Sep 13 16:24:50.325010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1121/2243] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:50.328027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.328681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.329290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.330136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.334179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.334797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.463637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:50.471872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8fb0ca75-06a3-41f3-b2a6-9cb929bdebe6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154922 Sep 13 16:24:50.472435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1123/2244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:50.790892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:50.791524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:50.794172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:50.799433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.799923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.800360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.801045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:50.801493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:50.801913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:50.938512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:50.946692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-90e08a63-ca4d-48ce-b110-e23c9ff5a288 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.160397 Sep 13 16:24:50.947292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1122/2245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:51.339651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:51.340270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:51.346760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.347283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.347726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.348419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.348875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.349308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.350004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:51.350644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:51.357033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.357505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.357934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.358615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.359091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.359508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.542338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:51.544612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:24:51.545426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:51.551835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab6d4850-289f-4eab-aee8-3e64c53de2ba tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216179 Sep 13 16:24:51.552416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1124/2246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:51 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:51.554753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:51.556353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:51.557484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:51.557623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a68ecb4-424e-4d00-a33a-7eab74a0789f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211840 Sep 13 16:24:51.558221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1123/2247] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:51.558360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:51.564240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.564720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.565182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.565874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.566330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.566761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.697005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:51.705209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b6ff6ad-4344-4d98-b2bf-905214150fdb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151805 Sep 13 16:24:51.705702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1125/2248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:51.970418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:51.971001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:51.978964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.979446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.979881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:51.980567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:51.981013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:51.981433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.125432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:52.134100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c12179fe-a42b-4ed6-9b5c-538084f42d68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.167518 Sep 13 16:24:52.134789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1124/2249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:52.575391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:52.576000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:52.583292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:52.583772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:52.584209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.584898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:52.585040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:52.585344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:52.586028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.586163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:52.593284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:52.593764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:52.594192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.594881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:52.595346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:52.595764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.787190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:52.794480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:52.796023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6b51db9-0915-4a0d-aa80-a297a1a7a3cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.224416 Sep 13 16:24:52.796649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1126/2250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:52 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:52.801037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:52.801643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:52.803764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:52.805962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:52.807224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-29bba81f-a02b-46b3-885c-7c47a4922fe1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.227420 Sep 13 16:24:52.807887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1125/2251] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:52.808157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:52.808642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:52.809087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.809787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:52.810243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:52.810672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:52.939880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:52.948920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2bb218af-ad29-47c6-bdd3-c8dc8b108d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151356 Sep 13 16:24:52.949495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1127/2252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:53.158734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:53.159318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:53.166423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:53.166892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:53.167351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:53.168028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:53.168473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:53.168891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:53.296523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:53.305490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e0ab8fb-bdf7-434e-b59a-5e35480e8c8e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150943 Sep 13 16:24:53.306061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1126/2253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:53.819378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:53.820118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:53.826662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:53.828412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:53.828412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:53.828412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:53.828766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:53.829162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:53.833652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:53.834271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:53.840853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:53.841333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:53.841768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:53.842450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:53.842927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:53.843344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:54.025301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:54.028971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:54.033478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81b8e3b6-c94c-41dc-bf7b-07b5a551693c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217960 Sep 13 16:24:54.034243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1128/2254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:53 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:54.037635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:54.038455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:54.039108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:54.039264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:54.040279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9e06809-cffd-4c27-afb4-c2065b452cb4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210542 Sep 13 16:24:54.041159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1127/2255] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:24:54.045493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:54.045774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:54.046255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:54.049202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:54.049679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:54.050121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:54.180309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:54.188681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-307ff85a-f48e-41b4-9bc9-e8452ed74895 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153449 Sep 13 16:24:54.189246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1129/2256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:54.329305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:54.329920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:54.336401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:54.336877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:54.337311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:54.338038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:54.338488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:54.338921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:54.466049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:54.474153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d88a0cda-7cec-4de1-95a6-b6c7fec46873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148727 Sep 13 16:24:54.474714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1128/2257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:55.057748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:55.058371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:55.065606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.065812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.066225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.066926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.067383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.067803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.067989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:55.068648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:55.074668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.075182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.075646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.076333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.076785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.077207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.262294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:55.265426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:55.270483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-340a719a-ed46-4e80-b42a-843bdb1ab9e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217556 Sep 13 16:24:55.271075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1130/2258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:55 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:55.276116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:55.276725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:55.282273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:55.282429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.282940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.283397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.284021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:55.284146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.284529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.284959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.285398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b4c7c78e-b89c-4fa5-ba2e-adee76ffaa4c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.223091 Sep 13 16:24:55.286059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1129/2259] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:55.412025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:55.420740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34238845-d4f6-4a22-a33c-d0bb26ce864a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148732 Sep 13 16:24:55.421297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1131/2260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:55.497510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:55.498114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:55.504429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.504910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.505346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.506024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:55.506474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:55.506919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:55.636335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:55.645256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfd9c9f2-187f-4591-a4a7-357a0a0b1567 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151519 Sep 13 16:24:55.645823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1130/2261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:56.295229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:56.295767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:56.302055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.302537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.303015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.303701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.304154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.304598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.310891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:56.311523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:56.317600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.318073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.318507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.319215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.319663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.320630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.498173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:56.504757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:56.506382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91f3ac19-cd6c-4e94-9d7b-ae6842b4e8cc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215100 Sep 13 16:24:56.506969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1132/2262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:56 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:56.511475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:56.512073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:56.514183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:56.515699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:56.516862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-149a381a-24aa-4cca-9412-0e719bf49d33 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.209792 Sep 13 16:24:56.517615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1131/2263] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:56.518169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.518659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.519195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.519900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.520358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.520790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.647872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:56.656826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17157554-a91c-44ff-85cd-9a4f92d9ff3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148890 Sep 13 16:24:56.657379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1133/2264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:56.669448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:56.670056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:56.675933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.676415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.676843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.677515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:56.677958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:56.678376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:56.806772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:56.815114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc6bd912-6886-4ae4-9a6d-ea5d678b2b3c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149445 Sep 13 16:24:56.815666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1132/2265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:57.530039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:57.530646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:57.537076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.537549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.537986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.538664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.539882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.540314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.542336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:57.542972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:57.549389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.549870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.550306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.551048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.551503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.551923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.733571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:57.736629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:57.742461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6c25de9-d95a-4e3e-a269-d8e21722f907 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215709 Sep 13 16:24:57.743125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1134/2266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:57 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:57.746348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:57.747481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:57.747817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:57.748086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:57.748967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9c4e14c-055c-43dc-ab44-9ac2194aa0f5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211411 Sep 13 16:24:57.749554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1133/2267] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:57.753775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.754260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.754724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.755652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.756109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.756536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.839184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:57.839801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:57.845729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.846210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.846640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.847357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:57.847807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:57.848231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:57.884646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:57.892878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-545d3ea3-9ad8-4cca-9f7a-6d4c995817d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148788 Sep 13 16:24:57.893666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1135/2268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:57.975937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:57.984697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d43e81ff-edb9-491e-8f16-bc2c1bf8e21f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149276 Sep 13 16:24:57.985259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1134/2269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:24:58.766461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:58.767099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:58.774245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:58.774724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:58.775134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:58.775583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:58.775736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:58.775924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:58.776380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:58.776806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:58.782286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:58.782799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:58.783269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:58.783966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:58.784443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:58.784871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:58.968162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:58.972804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:58.976504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-037425f2-0a89-4373-9e8d-6286092c39ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213866 Sep 13 16:24:58.977078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1136/2270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:58 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:58.981465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:58.981618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:58.982068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:58.983099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:58.984805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-499f50b9-a83e-4e1c-948c-a4fe4e19fbfe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213821 Sep 13 16:24:58.992670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1135/2271] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:24:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:24:58.992822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:58.992822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:58.992822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:58.992822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:58.993207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:58.993207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:59.008985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:24:59.009600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:24:59.015580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:59.016069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:59.016564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:59.017204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:24:59.017661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:24:59.018089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:24:59.188435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:59.197165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:24:59.197476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ca74813-1f64-4548-a72f-a39a8f30e763 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219421 Sep 13 16:24:59.198044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1137/2272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:24:59.205366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48564488-30ea-4b0f-bb9a-757f3f78b271 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.200652 Sep 13 16:24:59.205923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1136/2273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:00.000281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:00.000894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:00.007021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.008035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.008691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.009392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.009875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:00.010288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.010288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.010487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:00.016631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.017110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.017545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.018228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.018678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.019135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.200594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:00.207193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:00.208802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9de8c998-ed03-4525-918f-5c2889a5d8c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.212330 Sep 13 16:25:00.209561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1138/2274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:24:59 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:00.216037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:00.217484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:00.218646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da318e8b-c57c-4bf9-815b-35f5e94c7364 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213149 Sep 13 16:25:00.219354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1137/2275] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:00.219840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:00.220701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:00.228305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.228930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.229390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.229906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:00.230266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.230644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:00.230774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.231190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.236361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.236837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.237265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.237940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:00.238385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:00.238804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:00.253860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:00.423141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:00.427171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:00.431657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9041265a-2d41-4af3-b79a-df397b433cce tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215432 Sep 13 16:25:00.432230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1139/2276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:00.435601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f02f1485-5fb8-4a03-8c08-58f6003e8c5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.209815 Sep 13 16:25:00.436164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1138/2277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:01.233842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:01.234462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:01.240347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.240825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.241262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.241967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.242555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.243039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.244933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:01.245565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:01.251848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.252318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.252749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.253458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.253920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.254322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.436816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:01.439998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:01.445333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e6e7815-3add-434a-9f81-e7ad8c818e0b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216013 Sep 13 16:25:01.446056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1140/2278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:01 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:01.449712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:01.451262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:01.452497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d5bda2a-9347-4499-8e49-c37ac1a5a10a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211994 Sep 13 16:25:01.453126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1139/2279] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:01.454760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:01.455567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:01.459245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:01.459860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:01.463133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.463900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.464453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.465142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.465593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.466013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.466799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.467310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.467748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.468432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:01.468882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:01.469452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:01.482975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:01.660149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:01.663384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:01.669251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d8d9409-8bf4-45bd-bfc4-8dea92a7b3df tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218803 Sep 13 16:25:01.669909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1141/2280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:01.674007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-854e9c56-bb9c-4401-aeb5-f4de114c6ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218351 Sep 13 16:25:01.674660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1140/2281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:02.468838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:02.469446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:02.475971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.476483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.477255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.477961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.478405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.478815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:02.479287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.479486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:02.485808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.486295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.486728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.487445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.487897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.488322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.672050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:02.678994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:02.680334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08482e27-e704-4dd7-8119-b57e10ece128 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215251 Sep 13 16:25:02.680908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1142/2282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:02 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:02.688158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:02.689893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:02.692326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-981ee89c-4e53-4344-9944-c7fbbe759b03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216195 Sep 13 16:25:02.693327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:02.694034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:02.696349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1141/2283] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:02.700519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.700917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:02.701088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.701521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:02.701648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.702580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.703153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.703647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.707244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.708814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.708814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.708814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:02.709259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:02.709685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:02.894684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:02.901522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:02.903240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b7d2a51-8b38-43de-a45e-7234f2d3db99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214139 Sep 13 16:25:02.903813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1143/2284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:02.909462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48ceca7e-6e76-4aed-9477-0d5ba17f5bb6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212125 Sep 13 16:25:02.910013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1142/2285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:03.703947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:03.704473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:03.711714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.712205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.712648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.713354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.713808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.714239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.717580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:03.718188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:03.724430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.724904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.725344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.726019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.726592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.727960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.903846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:03.911896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3904739d-3ccd-4bca-bee4-cd82cafd907c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.211834 Sep 13 16:25:03.912471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1144/2286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:03 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:03.915269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:03.923933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:03.925385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:03.927070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:03.927070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:03.927273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f0c68bc4-3053-4839-8f5c-a82e5098c2fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212771 Sep 13 16:25:03.927418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1143/2287] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:03.932387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:03.932996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:03.936304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.936867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.937405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.938157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.938643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.938761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.939422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.939539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.939863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:03.940554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:03.941011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:03.941457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:04.127444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:04.134674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:04.136247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4a7b513-9754-441c-aac3-ec2eb9e1bc3e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214309 Sep 13 16:25:04.136825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1145/2288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:04.142817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3193fada-e211-4768-ad96-f3773fd28e84 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214477 Sep 13 16:25:04.143396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1144/2289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:04.940852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:04.941457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:04.948218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:04.948694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:04.949123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:04.949802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:04.950254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:04.950673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:04.952274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:04.952897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:04.959197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:04.959671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:04.960100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:04.960776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:04.961737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:04.962158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:05.140341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:05.147169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:05.148618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-665af951-d579-463f-a518-959f48fb2698 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.211713 Sep 13 16:25:05.149199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1146/2290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:04 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:05.156643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:05.158081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:05.159271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cab89db-f9b1-4c46-bcb8-2d193af24802 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210891 Sep 13 16:25:05.159810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1145/2291] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:05.161845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:05.162778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:05.166501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:05.167137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:05.169828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:05.170446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:05.170992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:05.171752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:05.172486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:05.173000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:05.173111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:05.173554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:05.173983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:05.174661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:05.175199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:05.175623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:05.594035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:05.596759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:05.602461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8445ed7d-d9fb-4339-958c-583ec9cad64b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.439609 Sep 13 16:25:05.603053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1146/2292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:05.605033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1e46e267-5617-4af9-9b79-4e57fe7defa1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.448174 Sep 13 16:25:05.605595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1147/2293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:06.171300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:06.171829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:06.178476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.179036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.179479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.180924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.181383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.181809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.186526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:06.187207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:06.194573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.195135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.195832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.196962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.197981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.197981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.385183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:06.388405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:06.394423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-99eb91b2-7dff-4708-be7e-558c47a407b1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.227055 Sep 13 16:25:06.395026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1147/2294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:06 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:06.397100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:06.399193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:06.400394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed30990d-61a7-4213-a580-0abec083ab58 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217975 Sep 13 16:25:06.400935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1148/2295] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:06.626074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:06.626689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:06.627913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:06.628534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:06.632770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.633209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.633650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.634336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.634789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.634924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.635248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.635358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.635772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.636466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:06.636924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:06.637357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:06.827782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:06.830738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:06.836731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d612f7c2-03bf-4d91-ae08-cb8eb53319b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214566 Sep 13 16:25:06.837331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1148/2296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:06.838890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36015e9f-6099-4f77-8d00-5856acb88fe4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214648 Sep 13 16:25:06.839467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1149/2297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:07.417197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:07.417806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:07.424538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.425029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.425469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.426001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:07.426395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.426610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:07.426723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.427079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.433575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.434048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.434478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.435190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.435638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.436057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.625176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:07.628441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:07.634221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5def3a36-af92-4a41-88e1-fe384a934f0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220974 Sep 13 16:25:07.634921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1149/2298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:07 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:07.636931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:07.638363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:07.639541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46a210f5-8392-49c4-a5ae-7fe8ba65e179 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217323 Sep 13 16:25:07.640072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1150/2299] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:07.860877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:07.861488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:07.862317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:07.862981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:07.868377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.869006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.869450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.869574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.869929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.870146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.870365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.870603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.871061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:07.871167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:07.871522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:07.871951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:08.062501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:08.063675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:08.071183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7aded5f6-00e5-46d9-9c8a-56393a65365f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214142 Sep 13 16:25:08.071756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1150/2300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:08.072225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c19bf6b3-60d4-45c6-b9e1-c96fae1faebe tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213635 Sep 13 16:25:08.072790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1151/2301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:08.657212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:08.657825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:08.664471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:08.664950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:08.665960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:08.666407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:08.666687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:08.666806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:08.667162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:08.667588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:08.673106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:08.673587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:08.674025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:08.674716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:08.675201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:08.675630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:08.858376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:08.861517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:08.866891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f0295e3-aeb0-440c-9441-9b63c685a31c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213463 Sep 13 16:25:08.867494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1151/2302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:08 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:08.870352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:08.871827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:08.872979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ed900d1-f37c-4076-9cfc-25c80cc8c53a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211462 Sep 13 16:25:08.873528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1152/2303] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:09.096074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:09.096276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:09.096689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:09.096855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:09.103196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.103404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.103694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.103823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.104134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.104342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.104827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.105031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.105277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.105479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.105788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.105891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.294472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:09.301403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:09.302679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09b38257-9c67-4d78-8055-f7ababc445f1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.210411 Sep 13 16:25:09.303489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1152/2304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:09.310538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b2095422-1d18-4e79-bcce-2ce8221ae911 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218069 Sep 13 16:25:09.312508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1153/2305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:09.891584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:09.892424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:09.897271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:09.897875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:09.898068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.898541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.898997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.900419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.901162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.901694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.905019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.905441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.905906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:09.906603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:09.907120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:09.907548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:10.094723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:10.101272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:10.103103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a5123a9-7470-4acf-84fa-5be970ec534a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215275 Sep 13 16:25:10.103757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1153/2306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:09 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:10.110095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:10.111580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:10.113348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d11aabc1-16cc-4270-917c-96f825e389df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.219308 Sep 13 16:25:10.113911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1154/2307] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:10.328522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:10.329176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:10.333822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:10.334444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:10.335612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:10.336094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:10.336577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:10.337383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:10.338094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:10.338693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:10.341016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:10.341643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:10.342191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:10.342988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:10.343535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:10.344095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:10.538262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:10.541711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:10.546617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86c4515f-4f1c-4bf7-b6c3-93fd49a94ba7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221869 Sep 13 16:25:10.547220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1154/2308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:10.549924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04088d86-d1ee-4955-98f4-b00da84e148e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219866 Sep 13 16:25:10.550483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1155/2309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:11.126474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:11.127124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:11.133081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.133582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.134020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.134804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.135280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.135707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.138797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:11.139440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:11.139689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:11.145955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.146437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.146870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.147598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.148078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.148503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.335308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:11.339112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:11.343564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c95ad8a2-bec9-4b10-bef4-c9003c45e4e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220876 Sep 13 16:25:11.344137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1155/2310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:11 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:11.347666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:11.349075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:11.350229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70c77987-fb40-4dbe-a47b-244aae295d1b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215374 Sep 13 16:25:11.350779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1156/2311] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:11.570887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:11.571890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:11.573055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:11.573772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:11.577926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.578404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.578843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.579553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.579686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.580002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.580118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.580422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.580532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.581145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:11.581597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:11.582020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:11.770770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:11.776962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:11.780609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d795b8d3-cdc7-4d60-a5ac-b9bd154ac7af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213171 Sep 13 16:25:11.782939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1156/2312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:11.785724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f063ed10-af7a-4ce5-b6a8-b422c4e5b079 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216365 Sep 13 16:25:11.786515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1157/2313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:12.367213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:12.367807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:12.375053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.375448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:12.375891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.376005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.376127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:12.376614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.377060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.377481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.382347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.382834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.383308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.384005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.384457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.384885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.388810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:12.572919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:12.576903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:12.581214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3b6f66d-02f2-4ee6-9296-ec9be8a7cf8f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217764 Sep 13 16:25:12.581794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1157/2314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:12 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:12.585409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:12.586845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:12.589003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-320eae22-3a64-4e66-a496-c0a5f61673c1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217365 Sep 13 16:25:12.589544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1158/2315] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:12.804854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:12.805383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:12.809298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:12.809916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:12.811617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.812098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.812552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.813227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.813676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.814099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.816027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.816506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.816942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:12.817623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:12.818076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:12.818502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:13.006865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:13.009755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:13.015760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5efa9632-3e4b-494a-a7e2-63ff4f5b66bb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.210263 Sep 13 16:25:13.016361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1159/2316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:13.017932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-14f78973-2b92-44ca-ade9-c6f74681295e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217062 Sep 13 16:25:13.018501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1158/2317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:13.605762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:13.606394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:13.612839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:13.613322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:13.613756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:13.614443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:13.614892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:13.615191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:13.615600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:13.615797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:13.622802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:13.623308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:13.623739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:13.624420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:13.624867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:13.625285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:13.815919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:13.819053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:13.824326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a3fe076-c1ab-41a6-883c-ac607ef466bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222995 Sep 13 16:25:13.824904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1160/2318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:13 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:13.827806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:13.829247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:13.830397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cb370fc-c9c1-4c0c-a8c9-cdf695f8544c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218969 Sep 13 16:25:13.830956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1159/2319] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:14.038844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:14.039931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:14.041777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:14.042464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:14.047202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.047693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.048138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.048444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.048832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.048942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.049285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.049410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.049743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.050044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.050493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.050926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.246349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:14.249175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:14.254650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a5e5bd1-89e7-49fb-9324-3c46d449ead0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217391 Sep 13 16:25:14.255258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1160/2320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:14.257217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c15d2fd-adf7-4f30-acb2-7c427a41cae7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222390 Sep 13 16:25:14.257769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1161/2321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:14.847264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:14.847885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:14.855234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.855714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.856138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.856251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:14.856826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.856951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:14.857266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.857683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.859186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:14.864738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.865219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.865648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:14.866334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:14.866782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:14.867235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:15.048587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:15.052772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:15.057010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b51ffacb-5732-458d-9b8d-1c5a3f0834eb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213480 Sep 13 16:25:15.057593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1161/2322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:14 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:15.061850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:15.063321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:15.064493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bf41529-b11d-4621-8781-4b5b6db7a8cc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213325 Sep 13 16:25:15.065298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1162/2323] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:15.279062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:15.279792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:15.281238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:15.281853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:15.285841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:15.286320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:15.286755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:15.287471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:15.287794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:15.287934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:15.288274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:15.288408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:15.288708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:15.289390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:15.289838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:15.290316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:15.433040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:15.442658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0d0ce22-0a32-4cd1-acc4-6f70546fbad2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.165125 Sep 13 16:25:15.443262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1163/2324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:15.566308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:15.575262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f33835ce-1a56-4314-8b3f-b3d5e2e0438c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.300604 Sep 13 16:25:15.575825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1162/2325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:16.080778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:16.081605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:16.088801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.089291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.089967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.090307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:16.090748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.090925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:16.091251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.091682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.097201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.097664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.098093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.098764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.099230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.099647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.284779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:16.288123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:16.293543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c711b9fc-3814-4727-bbbc-f0316cb4d2a6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216668 Sep 13 16:25:16.294107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1164/2326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:16 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:16.297425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:16.298881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:16.300073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-120154bd-74da-44f8-985c-244a804de4f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214547 Sep 13 16:25:16.300613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1163/2327] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:16.467864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:16.468479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:16.474399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.474883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.475354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.476042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.476489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.476907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.599038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:16.599648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:16.605467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.606095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.606367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.607078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:16.607527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:16.607955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:16.609074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:16.617310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36f0f792-ed3d-4e5c-9473-9f2db1ea4130 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153272 Sep 13 16:25:16.617967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1165/2328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:16.734189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:16.742491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ddeb5f8b-5b19-4b0f-b3a2-87130b798550 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.147309 Sep 13 16:25:16.743075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1164/2329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:17.316848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:17.327494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:17.328448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.328720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:17.329553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.329553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.329922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:17.330105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.330645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.330927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.336698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.337187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.337630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.338925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.339382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.339813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.523945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:17.527178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:17.532164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fef31898-63d0-46b5-9e0a-7237cacc63f4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219577 Sep 13 16:25:17.533058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1166/2330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:17 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:17.536195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:17.537643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:17.538801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51847f69-76cd-4676-9af1-4638dc068934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216942 Sep 13 16:25:17.539369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1165/2331] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:17.640870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:17.641476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:17.647350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.647839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.648274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.648957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.649409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.649840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.766866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:17.767634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:17.773965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.774452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.774892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.776232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:17.776876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:17.777310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:17.782744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:17.791158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14aa2f17-e250-4d6d-b322-4c0e9a4bd56d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153866 Sep 13 16:25:17.792276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1167/2332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:17.903079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:17.911195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94e313f0-e52a-458b-a4bc-272f49b77e6e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148525 Sep 13 16:25:17.911757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1166/2333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:18.556011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:18.556583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:18.563050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.563529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.563960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.564074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:18.564599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:18.565082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.565347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.565768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.571292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.571764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.572195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.573296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.573715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.574162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.757922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:18.761959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:18.766284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2b7a034-0387-45ef-a1e0-e69ae567b99c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214169 Sep 13 16:25:18.766848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1168/2334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:18 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:18.770940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:18.772461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:18.773624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bdfe0da-3000-4b42-8d76-6edf271a61f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213470 Sep 13 16:25:18.774171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1167/2335] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:18.815519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:18.816051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:18.821989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.822665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.823142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.823824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.824277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.824698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.935265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:18.936215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:18.942841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.943352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.943785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.944480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:18.944928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:18.945353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:18.953589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:18.962153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ca51a57-6a8b-4342-9f1f-2321deea619c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150784 Sep 13 16:25:18.963024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1169/2336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:19.078780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:19.086949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f746d493-8bed-4840-8381-2791b3f03fa3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.156401 Sep 13 16:25:19.087514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1168/2337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:19.789759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:19.791642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:19.797966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:19.798454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:19.798602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:19.799086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:19.799609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:19.800066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:19.800204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:19.800495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:19.806424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:19.807588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:19.808425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:19.809062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:19.809512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:19.809934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:20.104076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:20.112769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db33c950-29d9-4359-a888-871c8da32ccc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.327158 Sep 13 16:25:20.113378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1170/2338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:19 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:20.115330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:20.118665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:20.119815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:20.125584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:20.126093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:20.126533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:20.127253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:20.127709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:20.128265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:20.137588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:20.139232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:20.140671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e4666f7-e560-472d-9994-5b0e6b55859a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.346164 Sep 13 16:25:20.149244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1169/2339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:20.149244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:20.149244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:20.153860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:20.154463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:20.155442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:20.156258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:20.156774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:20.157263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:20.336428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:20.346430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19108956-2965-4e52-966b-ea82e8e28fe2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.231704 Sep 13 16:25:20.347018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1171/2340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:20.349474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:20.359772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08645ef5-10cd-4819-b144-f9b43a5ff5bc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217388 Sep 13 16:25:20.360362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1170/2341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:21.136187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:21.136802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:21.143188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.143670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.144110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.144804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.145263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.145692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.166702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:21.167535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:21.170968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:21.174606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.175164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.175612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.176355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.176792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.177218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.575943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:21.579928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:21.582081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:21.584764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a222dff4-2ecb-40b0-84b2-27f7101684f1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.452891 Sep 13 16:25:21.585342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1172/2342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:21 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:21.590361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:21.590527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:21.590998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:21.591987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:21.593152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-925e8471-d274-42c2-8c1c-f0f250821799 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.430792 Sep 13 16:25:21.593815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1171/2343] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:25:21.598265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:21.598968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:21.602848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.603372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.604423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.605382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.605763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.605879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.606244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.606355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.606682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.607394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:21.607846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:21.608270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:21.801378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:21.804118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:21.810235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da2faacc-6a08-4641-a4b7-5b44ba8299ba tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215585 Sep 13 16:25:21.810805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1172/2344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:21.813013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9dcc508b-6023-478d-92e7-0320dd2c8111 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.226709 Sep 13 16:25:21.813562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1173/2345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:22.608126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:22.608739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:22.615404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.615824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.616259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.616943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.617392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.617824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.618751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:22.619662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:22.625859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.626337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.626770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.627486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.627940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.628362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.811702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:22.816028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:22.818213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:22.820142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e23e8c9f-2959-422b-92e1-a1d125059d79 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215820 Sep 13 16:25:22.820711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1173/2346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:22 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:22.826502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:22.828400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:22.829492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b355a2dd-b012-48eb-bf32-f5607e4ddc94 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214557 Sep 13 16:25:22.830035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1174/2347] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:22.834786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:22.835734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:22.839502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:22.840139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:22.842950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.843293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.843733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.844420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.844870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.845297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.846224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.846740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.847212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:22.847903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:22.848359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:22.848816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:23.028800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:23.036960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-63a760c4-d8c9-4816-98ba-9250f5b9a9d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.205880 Sep 13 16:25:23.037521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1174/2348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:23.039763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:23.048830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce2cbe3f-a611-4097-a12f-901083ba6632 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213992 Sep 13 16:25:23.049396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1175/2349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:23.843500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:23.844109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:23.850515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:23.851016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:23.851451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:23.852130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:23.852573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:23.852990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:23.855700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:23.856314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:23.862674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:23.863202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:23.863640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:23.864333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:23.864783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:23.865214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:24.037853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:24.047574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-040d7cbf-de0c-4a36-acf7-99cfd9dfcfd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.207826 Sep 13 16:25:24.048154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1175/2350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:23 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:24.052081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:24.060999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:24.061629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:24.065401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:24.066366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:24.067851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:24.068010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-644b6c79-4a3b-4630-957a-8a8182f52a04 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216327 Sep 13 16:25:24.068331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:24.068440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1176/2351] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:24.068829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:24.069595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:24.070047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:24.070472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:24.073620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:24.074173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:24.080042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:24.080531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:24.080975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:24.081670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:24.082139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:24.082653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:24.268825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:24.275250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:24.278138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab4f2c7d-f89c-458a-9bca-c02ac74ba51b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220899 Sep 13 16:25:24.278793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1176/2352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:24.284456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3755a0ea-ff13-42a4-bab8-19ec674b1246 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214897 Sep 13 16:25:24.285020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1177/2353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:25.070867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:25.071392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:25.078453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.078964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.079407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.080098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.080598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.081061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.094557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:25.095221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:25.101623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.102114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.102553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.103289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.103769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.104294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.282786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:25.289605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:25.291138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64fba07a-3ee2-4308-bc33-8161df76974a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.224417 Sep 13 16:25:25.291768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1177/2354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:25.298607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:25.300330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:25.301345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:25.301880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe000a40-8e20-486c-bf04-5f5d6fa0bf32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211503 Sep 13 16:25:25.302014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:25.302978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1178/2355] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:25.308171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:25.308782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:25.313432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.314131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.314459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.314773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.314979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.315680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.316035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.316404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:25.316692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.316858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:25.317285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.317478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:25.513660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:25.516380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:25.523286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f1c559c-d5f3-45c4-a19c-436e2a597fbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.225664 Sep 13 16:25:25.523864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1178/2356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:25.524469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a033215-6ba4-486b-a4a5-a7d6eeb2e811 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.220355 Sep 13 16:25:25.525019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1179/2357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:26.314608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:26.315214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:26.321843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.322401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.322875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.323588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.324040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.324462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.328145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:26.328757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:26.334813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.335320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.335761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.336451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.336908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.337334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.522479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:26.530042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:26.531373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-caf5cb53-747c-4e2f-9b2a-5c9819a95bb3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220676 Sep 13 16:25:26.531950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1179/2358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:26 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:26.538598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:26.540071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:26.542429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76cbe673-6a0b-4779-ab8b-948cde2bcebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216881 Sep 13 16:25:26.542429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1180/2359] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:26.547276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:26.547574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:26.548197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:26.548325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:26.554000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.554266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.554632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.554749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.555186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.555325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.555890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.555997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:26.556346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.556460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:26.556775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.556983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:26.749721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:26.753709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:26.758180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86cc3b37-3bb7-4603-87d6-b9ee270c06be tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214256 Sep 13 16:25:26.758745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1181/2360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:26.761881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1eb58a0-8d90-42f1-9331-87b690f812c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219468 Sep 13 16:25:26.762443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1180/2361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:27.554963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:27.555576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:27.562648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.563164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.563602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.564290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.564742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.565162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.567553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:27.568171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:27.574935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.575420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.575887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.576578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.577031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.577457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.761926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:27.764466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:27.770325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e982ebf5-d3eb-42a9-8d89-09f4cbf594ea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219217 Sep 13 16:25:27.771014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1182/2362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:27 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:27.773104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:27.774560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:27.776126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-193fff5b-d0aa-4eae-8313-9fc6321ab7b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212352 Sep 13 16:25:27.777069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1181/2363] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:27.781541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:27.782221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:27.787904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:27.788566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.788703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:27.789056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.789492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.790178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.790628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.792095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.795875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.796354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.796789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.797468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:27.798373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:27.798518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:27.939310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:27.948458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e3dd95a3-d136-42ff-b74a-232d87f195f4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.164180 Sep 13 16:25:27.948966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1182/2364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:28.079168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:28.087230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8ae3379-9671-40dc-83c1-058ce2d3d0e5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.309451 Sep 13 16:25:28.087792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1183/2365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:28.793700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:28.794316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:28.796776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:25:28.796925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:25:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d (ip 10.222.0.50) !!! Sep 13 16:25:28.802317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:28.802953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:28.803279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:28.803766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:28.804209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:28.804908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:28.805395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:28.805827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:28.809414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:28.809894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:28.810337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:28.811045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:28.811503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:28.811923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:28.999748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:29.003008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:29.008331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:29.009779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:29.011142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab7052eb-2628-444b-a13a-99860e7c32b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212726 Sep 13 16:25:29.011703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1184/2366] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:25:29.011838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4b04671a-3684-4862-a60f-25c2beb0cecf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222107 Sep 13 16:25:29.012457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1183/2367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:28 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:29.016001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:29.016607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:29.022460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:29.022971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:29.023403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:29.024085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:29.024540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:29.024963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:29.110941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:29.111771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:29.120427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:29.120912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:29.121439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:29.122187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:29.122653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:29.123116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:29.154957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:29.163181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-194953a6-8e02-488c-be3f-b99f0c0d153b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150508 Sep 13 16:25:29.163743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1185/2368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:29.255009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:29.263406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2e289d98-5000-4941-89c9-fb15149af979 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.156361 Sep 13 16:25:29.263967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1184/2369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:30.035676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:30.036220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:30.039210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:30.044771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:30.044962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.044962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.044962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.045225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.045519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.045939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.046564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.047087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.047529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.048220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.048672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.049095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.233956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:30.240646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:30.242124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4e76ca5-507e-4993-a011-e1b797a10cc7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.210395 Sep 13 16:25:30.242682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1186/2370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:30.247724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:30.248330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:30.250848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:30.252339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:30.253710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a902c78e-4365-413a-98b9-8e69d56c888f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218316 Sep 13 16:25:30.254031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.254596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1185/2371] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:25:30.254726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.255029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.255722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.256172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.256596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.286319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:30.286840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:30.293494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.293975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.294409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.295122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:30.295572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:30.295991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:30.439166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:30.448803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e5e2c7c-247a-4d43-8089-015e89d8fbff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.204949 Sep 13 16:25:30.449866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1187/2372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:30.462234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:30.471100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2580d2c0-3de7-44da-8dfa-b7892f3f2d99 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.188438 Sep 13 16:25:30.471632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1186/2373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:31.265796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:31.266414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:31.272872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.273355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.273799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.274493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.274977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.275409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.277912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:31.278750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:31.285114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.285592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.286030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.286721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.287206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.287631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.471001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:31.474715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:31.479967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e014f56-eba1-47ce-b49a-c1e49a6fc22e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217375 Sep 13 16:25:31.480543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1188/2374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:31 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:31.485313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:31.485927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:31.487708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:31.489534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:31.491129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d6e25f7-c3d0-4faa-b674-ab6a5c70c28a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217560 Sep 13 16:25:31.491843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1187/2375] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:31.493490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.494158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.494878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.495978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.496440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.496906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.497504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:31.498247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:31.504421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.505014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.505559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.506353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:31.506964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:31.507528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:31.523020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:31.695161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:31.698675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:31.703569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e756919-62d1-46b2-870d-4ecbf900f547 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221998 Sep 13 16:25:31.704137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1189/2376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:31.706834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-71530a4b-3bc9-41e4-aa33-92c06adbe6bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213710 Sep 13 16:25:31.707420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1188/2377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:32.502624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:32.503264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:32.509532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.510010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.511230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.512017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.512496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.512917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.516251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:32.516870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:32.523161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.523658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.524109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.524795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.525250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.525679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.712136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:32.715279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:32.721140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82771a88-9f1c-4950-83fc-3f7af3c196e7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222747 Sep 13 16:25:32.721709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1190/2378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:32.724292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:32.725304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:32.726464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5471571d-5eaf-42a4-b678-a09ba7d983f0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214199 Sep 13 16:25:32.727021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1189/2379] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:32.738768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:32.738768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:32.739104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:32.739104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:32.739104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.739104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.739503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.739503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.739852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.740475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.745389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.746186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.746890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.747623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:32.748079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:32.748509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:32.763965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:32.934285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:32.938497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:32.942801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-baa40f59-97bd-431f-88c3-f19775421644 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214840 Sep 13 16:25:32.943406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1190/2380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:32.947034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e7fb658-0a73-4e25-8a53-4c7c759a866f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.223223 Sep 13 16:25:32.949559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1191/2381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:33.744552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:33.745345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:33.751782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.752263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.752697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.752914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:33.753385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.753558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:33.753833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.754258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.759720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.760721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.761500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.762053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.762508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.762960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.954120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:33.958160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:33.963018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:33.965646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:33.967007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-520aa74c-f4af-4a33-a903-03d634face4f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217956 Sep 13 16:25:33.967594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b5be247-b96d-45ca-99ec-9541e0117a09 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.226949 Sep 13 16:25:33.967715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1192/2382] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:33.979162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1191/2383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:33 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:33.979367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:33.979367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:33.979551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:33.979551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:33.979716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.979802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.979892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.980018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.980109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.980206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.980589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.980706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:33.981043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.981165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:33.981483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:33.981604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:34.180160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:34.186692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:34.189373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-79055876-c265-4367-939f-f96e7f48fa80 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220075 Sep 13 16:25:34.190003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1192/2384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:34.195372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2240ed84-c610-43e3-bce7-267316c966d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.226814 Sep 13 16:25:34.195924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1193/2385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:34.992811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:34.993356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:34.993747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:34.993957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:34.999997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.000476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.000686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.000910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.001163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.001588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.001705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.002034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.002274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.002452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.002726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.003178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.205326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:35.212377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:35.222814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:35.223883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92daa628-90c5-42dc-9b32-c9390c218314 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.234251 Sep 13 16:25:35.224391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:35.224534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1194/2386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:34 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:35.241165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83e380c2-6cec-401e-ba2c-c41c77e59120 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.236684 Sep 13 16:25:35.241392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:35.241392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:35.241591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1193/2387] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:25:35.241591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:35.241591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:35.245993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.246483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.246980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.247681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.248133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.248556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.254603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.255135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.255571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.256259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:35.256733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:35.257155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:35.278694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:25:35.278939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f (ip 10.222.0.50) !!! Sep 13 16:25:35.441245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:35.447832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:35.449771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd113ad8-c13d-4668-b70b-956df26d6918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.224351 Sep 13 16:25:35.450354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1195/2388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:35.456467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dfebd734-08da-463c-a839-03d59b354efa tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222939 Sep 13 16:25:35.457095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1194/2389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:36.249207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:36.249825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:36.252358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:36.252967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:36.256375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.256860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.257303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.258000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.258454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.258880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.259344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.259822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.260762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.261454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.261905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.262333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.451293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:36.455345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:36.459562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2aee80a-d414-4380-987c-4f1093e10509 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215096 Sep 13 16:25:36.460142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1196/2390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:36 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:36.464633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:36.466080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:36.467281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95d7a5cf-b9b3-49f0-8461-e1f3e07a56b9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218700 Sep 13 16:25:36.480972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1195/2391] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:36.481201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:36.481201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:36.481385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:36.481480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.481582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:36.481674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.481674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.482389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.482845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.483294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.486928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.487410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.487853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.488552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:36.489008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:36.489438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:36.675157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:36.678241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:36.684044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a45c4d4b-50df-4e39-bbfe-9c672fc8ad45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214710 Sep 13 16:25:36.684709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1197/2392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:36.687065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-27d8be17-6506-4600-8538-ff17a6a3225a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.211239 Sep 13 16:25:36.687621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1196/2393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:37.483973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:37.484589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:37.491015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.491501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.491939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.492635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.493087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.493512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.494589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:37.495902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:37.502159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.502645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.503116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.503850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.504309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.504735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.688857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:37.697696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ed9d05c-40b8-4198-8bfb-c9d09eaf6431 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217651 Sep 13 16:25:37.698129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:37.698545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1198/2394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:37 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:37.707415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:37.708859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:37.709977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:37.710105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-708ad64f-caa6-42b4-9668-15121595bad9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.220421 Sep 13 16:25:37.710705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1197/2395] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:37.710835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:37.715377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:37.716025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:37.717392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.718141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.718589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.719446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.719905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.720331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.722128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.722607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.723078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.723766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:37.724217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:37.724646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:37.913399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:37.916275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:37.921801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa31af33-f02d-4734-a3a2-e4ded1f12a99 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215706 Sep 13 16:25:37.922376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1199/2396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:37.924625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a83da945-3247-4470-86ae-f09463ddb129 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212993 Sep 13 16:25:37.925316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1198/2397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:38.730152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:38.730832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:38.737238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.737716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.738151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.738833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.739311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.739731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.743092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:38.743721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:38.750755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.751273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.751712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.752403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.752854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.753283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.936192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:38.946041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:38.947624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8e24fb9-492f-4e7c-bc20-6289a9a0f578 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.221293 Sep 13 16:25:38.948214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1200/2398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:38 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:38.953309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:38.953943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:38.959748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.960232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.960673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.961364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.961816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.962250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.969315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:38.970790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:38.972107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8bf6072-3560-44a8-8a55-42480d1356c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.232938 Sep 13 16:25:38.972822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1199/2399] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:38.977208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:38.977838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:38.984494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.984917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.985357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:38.986049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:38.986657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:38.987154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:39.379369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:39.387640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9c57786-f466-4e0d-9b45-809b70c96798 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.437903 Sep 13 16:25:39.388202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1201/2400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:39.393747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:39.402505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bebcad39-09a0-4ab2-b465-faea24285976 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.428218 Sep 13 16:25:39.403177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1200/2401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:39.972539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:39.973176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:39.979689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:39.980789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:39.981224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:39.981904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:39.982351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:39.982771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:39.999305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:39.999912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:40.005697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:40.006225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:40.006648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:40.007443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:40.007892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:40.008320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:40.181777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:40.185893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:40.190104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92b3453e-677d-4fe8-a277-bf7ba2c4c0f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.221414 Sep 13 16:25:40.190682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1202/2402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:39 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:40.195317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:40.196828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:40.198065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-588d80e3-ca86-4f5f-88e1-e8e75ca9b42e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.203233 Sep 13 16:25:40.198792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1201/2403] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:40.411870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:40.412486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:40.419167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:40.419676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:40.420115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:40.420808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:40.421262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:40.421684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:40.429559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:40.430331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:40.436867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:40.437353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:40.437794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:40.438490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:40.438976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:40.439440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:40.610529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:40.618665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3500c3f-2643-4dbf-aec9-321f5bcb150c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.210823 Sep 13 16:25:40.619269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1203/2404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:40.626930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:40.635045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6974cc90-f184-4dbc-a9c5-161c5af7ab98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209453 Sep 13 16:25:40.635599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1202/2405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:41.214116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:41.215039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:41.222764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.223278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.223831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.224465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:41.224902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.225081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:41.225200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.225551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.231799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.232284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.232722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.233441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.233894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.234318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.417387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:41.421730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:41.426390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fcd76681-3276-4510-a0d0-bba6eaaab9bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217151 Sep 13 16:25:41.426988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1204/2406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:41 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:41.430295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:41.431833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:41.433002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21170e35-4840-48d4-80bc-d0358ee3c832 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212643 Sep 13 16:25:41.433676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1203/2407] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:25:41.641620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:41.642160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:41.649027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.649510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.649956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.650644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.651133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.651562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.658272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:41.658923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:41.665170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.665646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.666078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.667294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:41.667426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:41.667791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:41.848531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:41.852298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:41.857305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ac0d340-44f6-4584-a7c2-ce2bb664872b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219579 Sep 13 16:25:41.857870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1205/2408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:41.861548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efbd9db9-adfb-423e-bd1d-31254f1f4e1a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.207066 Sep 13 16:25:41.862096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1204/2409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:42.450308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:42.450952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:42.457472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.457955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.458394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.458511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:42.459092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:42.459213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.459555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.459980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.464944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.465666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.465937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.466610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.467098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.467520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.470106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:42.595955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:25:42.596163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d (ip 10.222.0.50) !!! Sep 13 16:25:42.658329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:42.662234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:42.666591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f310b2a-c819-4484-8b73-d190c64510ae tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220818 Sep 13 16:25:42.667189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1206/2410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:42 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:42.672850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:42.674281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:42.675476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a18a19f8-480c-4d09-bb42-b0adb7f70d03 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.220883 Sep 13 16:25:42.676021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1205/2411] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:42.880932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:42.881567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:42.884498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:42.885110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:42.887714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.888306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.888737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.889424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.889863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.890282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.891226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.891708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.892145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:42.892827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:42.893268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:42.893686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:43.081280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:43.085273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:43.089463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f12676f-0975-4604-94d2-0b397824ca44 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.208657 Sep 13 16:25:43.090581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1206/2412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:43.094039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d985cb09-ebcd-4454-acac-b4e73894b0dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216972 Sep 13 16:25:43.094595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1207/2413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:43.689947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:43.690556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:43.697340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:43.697824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:43.698261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:43.698966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:43.699953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:43.700539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:43.701919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:43.702527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:43.708752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:43.709230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:43.709667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:43.710354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:43.710805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:43.711256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:43.713828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:43.895707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:43.899789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:43.907888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6e373f36-c8d5-4511-87d0-bfe16aecfbea tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.221825 Sep 13 16:25:43.908467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1207/2414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:43 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:43.909046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:43.910565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:43.911817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0dee1326-11c9-4d40-9d71-c113b8edb7e8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214328 Sep 13 16:25:43.912434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1208/2415] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:44.114008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:44.114616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:44.117208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:44.117820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:44.120594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.121065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.122750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.123650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.124100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.124320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.124526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.124799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.125239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.125924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.126366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.126788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.315607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:44.322498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:44.323882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ecbfd6ef-c071-4ab3-8de8-47f558655585 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213712 Sep 13 16:25:44.324467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1208/2416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:44.330848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2379f52-9e5d-4d05-b703-1c7ea7b238e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217344 Sep 13 16:25:44.331551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1209/2417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:44.931162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:44.931685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:44.936998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:44.937610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:44.938392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.938876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.939339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.939959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=96 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:44.940076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.940459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.940890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.945582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.946061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.946500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:44.947215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:44.947668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:44.948094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:45.133593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:45.136562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:45.142462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0617f7d4-40f4-4ec6-9e4a-e5f3ddd03f7e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215210 Sep 13 16:25:45.143077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1209/2418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:44 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:45.145852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:45.147344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:45.148508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-590360e2-d777-4dfa-8f77-8e7b48c866f9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215425 Sep 13 16:25:45.149051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1210/2419] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:45.347042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:45.347659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:45.353323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:45.353824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:45.353960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:45.354322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:45.354764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:45.355484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:45.355998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:45.356542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:45.359910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:45.360395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:45.360822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:45.361504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:45.361948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:45.362366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:45.552319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:45.555335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:45.561652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b92f65c6-cc9e-4a9f-b855-b32a3ace77e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218439 Sep 13 16:25:45.562302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1210/2420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:45.563593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75eb78b5-9468-4ac9-9de6-5c557b3c4a10 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214027 Sep 13 16:25:45.564156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1211/2421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:46.166226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:46.166830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:46.173462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:46.174061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:46.174220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.174741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.175248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.175919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.176371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.176800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.180294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.180765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.181199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.181889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.182336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.182754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.370114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:46.373307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:46.378642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67d7186e-ce81-47f5-a501-93a0085708fa tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216196 Sep 13 16:25:46.379269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1211/2422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:46 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:46.381913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:46.383372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:46.384529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cdd1da9-ff05-4af5-8535-f9f0e9a980c5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214867 Sep 13 16:25:46.385073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1212/2423] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:46.585396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:46.586165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:46.586803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:46.587425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:46.592882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.593398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.593835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.594520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.594648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.594995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.595138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.595422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.595542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.596203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:46.596649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:46.597068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:46.787336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:46.790374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:46.796061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55eb4899-4e68-4389-9d86-192fc7c385cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214702 Sep 13 16:25:46.796636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1212/2424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:46.798638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40c19648-cb56-4ad9-b2f1-f60d1915a3be tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215578 Sep 13 16:25:46.799230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1213/2425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:47.403249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:47.403866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:47.408467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:47.409082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:47.410376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.410854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.411320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.412001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.412440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.412864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.415260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.415738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.416176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.416878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.417317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.417746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.603365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:47.610662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:47.612577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30eda7fb-2854-4c20-83a0-a6dcbaadb1f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213267 Sep 13 16:25:47.613148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1213/2426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:47 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:47.619339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:47.620810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:47.621997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e54c4e1-d210-4b92-a9e0-7da033f36327 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217385 Sep 13 16:25:47.622536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1214/2427] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:25:47.819957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:47.820624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:47.827194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.827784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.828097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:47.828232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.828709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:47.828929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.829378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.829810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.834637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.835172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.835610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:47.836302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:47.836754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:47.837180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:48.023509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:48.027351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:48.032721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6261dd43-f37c-45fd-a791-b78302bf1c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216885 Sep 13 16:25:48.033294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1214/2428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:48.036308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74c42a69-55eb-432e-b44c-30cebd478e04 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211932 Sep 13 16:25:48.036873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1215/2429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:48.635738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:48.636329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:48.643403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:48.643888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:48.644325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:48.645012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:48.645463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:48.645684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:48.646105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:48.646249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:48.654087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:48.654805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:48.655430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:48.656135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:48.656586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:48.657013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:48.846502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:48.852893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:48.855198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67139d2b-9352-499a-b031-6fd822e6e1c0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.223281 Sep 13 16:25:48.856158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1215/2430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:48 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:48.864473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:48.865946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:48.867174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55e4f9e8-3279-46d1-971b-a77581f4dd3b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.225319 Sep 13 16:25:48.867727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1216/2431] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:49.056673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:49.057279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:49.061465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:49.062075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:49.063905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.064392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.065239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.065508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.065956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.066381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.068305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.068786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.069218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.069901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.070347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.070769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.257579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:49.261482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:49.266202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6662dc0e-31db-4ebb-95dd-d453be0f5e5d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213354 Sep 13 16:25:49.266771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1216/2432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:49.270172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5af6c672-d7cc-4d8f-bab3-6a938c7b355b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212585 Sep 13 16:25:49.270801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1217/2433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:49.879338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:49.879949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:49.886299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.886781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.887250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.887982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.888426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.888843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.893309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:49.893923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:49.900295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.900773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.901201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:49.901883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:49.902327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:49.902747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:50.085171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:50.093804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3e86a96-7751-4d10-81e9-7adf8ec3f419 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218330 Sep 13 16:25:50.094374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1217/2434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:49 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:50.096910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:50.105550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:50.107980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:50.109036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb79c79d-184c-4d23-b589-a601e2400a06 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.219568 Sep 13 16:25:50.109591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1218/2435] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:50.289734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:50.290341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:50.293953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:50.294638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:50.297081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:50.297556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:50.297991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:50.298666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:50.299138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:50.299557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:50.300597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:50.301078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:50.301516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:50.302203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:50.302658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:50.303113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:50.490711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:50.494615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:50.499077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e392b9f-7915-49c9-a86d-82937deda546 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213232 Sep 13 16:25:50.499653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1218/2436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:50.502923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3306afdf-2438-4557-b8dc-b97c8c83489c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212754 Sep 13 16:25:50.503466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1219/2437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:51.117221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:51.117863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:51.124989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.125469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.125907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.126590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.127073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.127500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.133547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:51.134163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:51.140880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.141370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.141927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.142514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.142995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.143425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.328157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:51.335376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:51.336370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af5cf909-41ae-400b-8ad8-9753195ab9ec tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.223042 Sep 13 16:25:51.336941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1219/2438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:51 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:51.344813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:51.346259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:51.347443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5e1107f-e1fa-467c-bb1a-a1e7c82b961e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217791 Sep 13 16:25:51.347984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1220/2439] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:51.523109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:51.523648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:51.525486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:51.526655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:51.527340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:51.531539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.532022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.532469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.533161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.533611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.533935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.534073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.534423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.534869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.535589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:51.536042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:51.536475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:51.719869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:51.729031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e916efe-42e8-485c-8c96-d6fade6d7fa9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209007 Sep 13 16:25:51.729031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1220/2440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:51.732102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:51.740817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-037d14bd-74ae-4bfd-93ce-313801e221e9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218105 Sep 13 16:25:51.741369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1221/2441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:52.360321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:52.360965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:52.367374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.368073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.368287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.368972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.369426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.369851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.373575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:52.374187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:52.380307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.380797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.381241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.381936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.382395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.382821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.564358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:52.566629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:52.571762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:52.574560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa1a114a-f3cf-4b0f-9b53-020cc55cebd6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218318 Sep 13 16:25:52.575268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1221/2442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:52 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:52.580836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:52.582286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:52.583500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0360446-0c42-4db6-bcf1-4a9c4f1c8136 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214414 Sep 13 16:25:52.584036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1222/2443] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:52.751464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:52.751994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:52.757832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.758311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.758749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.759462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.759914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.760339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.765033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:52.765730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:52.771562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.772048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.772490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.773193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:52.773649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:52.774078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:52.952231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:52.960715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f0be6ca-125c-4b76-8240-af659f53eb85 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213553 Sep 13 16:25:52.961109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1222/2444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:52.963578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:52.972378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc3a9eb0-6bbb-4012-860c-70b0e3833860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211721 Sep 13 16:25:52.972942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1223/2445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:53.598332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:53.598958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:53.605344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:53.605820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:53.606250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:53.607001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:53.607445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:53.607864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:53.608471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:53.609079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:53.616156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:53.616640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:53.617083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:53.617783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:53.618240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:53.618671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:53.800876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:53.808238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:53.809052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43cead86-95f3-4fd3-920f-38ee155b0f47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214571 Sep 13 16:25:53.809627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1223/2446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:53 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:53.811093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:25:53.819103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:53.820581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:53.821734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b0046fe-c6c9-4eaf-8642-453d6c7c0791 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217087 Sep 13 16:25:53.822279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1224/2447] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:53.984851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:53.985362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:53.991533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:53.992012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:53.992443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:53.993132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:53.993575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:53.994004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:53.996364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:53.996973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:54.003141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:54.003629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:54.004070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:54.004745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:54.005186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:54.005612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:54.250391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:54.255257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:54.259156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ed08819-c20f-4996-99e8-ebf267d57abd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.278702 Sep 13 16:25:54.259825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1224/2448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:54.264472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1fed4341-2868-46ca-8589-898f5038e19f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.271826 Sep 13 16:25:54.265041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1225/2449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:54.832209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:54.832817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:54.839281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:54.839765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:54.840235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:54.840930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:54.841809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:54.842359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:54.846939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:54.847545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:54.853929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:54.854409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:54.854848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:54.855578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:54.856025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:54.856444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:55.036231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:55.043561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:55.047487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7cc2f5be-d45a-4820-bd73-864e4c79301d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218980 Sep 13 16:25:55.048066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1225/2450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:54 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:55.055823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:55.057256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:55.058499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ba08716-cf08-40d4-beb5-fbf6b90c9d7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215566 Sep 13 16:25:55.059243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1226/2451] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:55.283725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:55.284540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:55.289349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:55.289962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:55.290541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:55.291049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:55.291483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:55.292163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:55.292608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:55.293029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:55.296087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:55.296590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:55.297039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:55.297729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:55.298184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:55.298608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:55.486069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:55.490060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:55.494498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0369cc2-ec7b-494a-9fa4-f01d77ce2f13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214484 Sep 13 16:25:55.495104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1226/2452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:55.499136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87a54a87-0183-4378-9840-1078f2f0b832 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213483 Sep 13 16:25:55.499702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1227/2453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:56.070879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:56.071501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:56.077830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.078304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.078731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.079517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.079967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.080384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.084162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:56.084772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:56.091051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.092670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.093113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.093811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.094260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.094680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.274751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:56.282804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:56.284422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-525a6820-c86b-4ba0-8980-f24921e2e2d0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217450 Sep 13 16:25:56.286465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1227/2454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:56 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:56.292298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:56.293731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:56.295136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d41999bb-4506-4920-ac6b-4a05cbdf2b10 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214519 Sep 13 16:25:56.295811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1228/2455] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:56.518240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:56.518842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:56.522030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:56.522668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:56.524859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.525334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.525762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.526445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.526914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.527342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.528382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.529569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.530284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.530993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:56.531440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:56.531860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:56.720923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:56.724911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:56.729197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3636ad0-e34a-497b-b093-596a0e7934d7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214922 Sep 13 16:25:56.729877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1228/2456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:56.733297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54972e50-2051-4899-b64b-4af14f7418b4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214994 Sep 13 16:25:56.733991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1229/2457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:57.309243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:57.309850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:57.316671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.317382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.317818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.318501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.318980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.319402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.320674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:57.321277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:57.327610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.328091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.328527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.329215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.329660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.330079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.514093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:57.518115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:57.522377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-90b0829b-acfa-46e0-aa71-828524c15ae2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217067 Sep 13 16:25:57.522959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1229/2458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:57 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:57.526658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:57.528156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:57.529881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ba43055-0aff-41be-9fc2-23fc42f666de tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213265 Sep 13 16:25:57.530539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1230/2459] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:57.752701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:57.753308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:57.756071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:57.756684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:57.759200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.759681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.760114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.760799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.761246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.761668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.762649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.763670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.764259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:57.765137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:57.765590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:57.766019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:58.191338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:58.198272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:58.199879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22ab2ad4-0b1e-4b72-a12e-151ace1cc99a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.451082 Sep 13 16:25:58.200529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1230/2460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:58.207179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99c3886e-4705-4705-a3c7-b95e659940a2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.454826 Sep 13 16:25:58.207739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1231/2461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:25:58.545961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:58.546560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:58.552900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:58.553375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:58.553801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:58.554475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:58.554919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:58.555352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:58.555352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:58.555557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:58.562888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:58.563418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:58.563853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:58.564538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:58.564983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:58.565404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:58.749876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:58.753148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:58.758076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb7efb47-a087-44fc-86d5-c20ff30e28bb tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216475 Sep 13 16:25:58.758650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1231/2462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:58 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:58.761669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:58.763164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:58.764683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e860244-fe64-4a93-abe4-28a12242bf18 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213591 Sep 13 16:25:58.765227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1232/2463] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:25:59.224596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:59.225302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:59.230336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:59.231074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:59.231677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.232261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.232464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.233156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.233601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.234025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.237133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.237604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.238039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.238721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.239189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.239608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.420939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:59.427729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:59.429134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-317cfa3b-656b-48a4-9f08-8b55e0fcb9b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.208389 Sep 13 16:25:59.429808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1232/2464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:59.437002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4fa8edd4-1e98-4508-a984-21696a8d0a1f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.209555 Sep 13 16:25:59.437571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1233/2465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:25:59.781804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:59.782326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:59.789289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:25:59.789894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:25:59.790265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.790743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.791215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.791892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.792340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.792759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.795790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.796265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.796704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.797441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:25:59.797952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:25:59.798369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:25:59.991337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:25:59.994395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:00.000024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-127d8984-ae3d-417e-9f65-edfb9609a710 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222708 Sep 13 16:26:00.000682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1233/2466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:25:59 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:00.003993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:00.005481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:00.006639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ae6e6ca-d8cd-4c5d-8e30-0cfb01d1a8b1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.221176 Sep 13 16:26:00.007218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1234/2467] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:25:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:00.452765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:00.453387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:00.459621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:00.460108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:00.460569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:00.461261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:00.461469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:00.461742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:00.462081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:00.462203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:00.468992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:00.469468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:00.469904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:00.470585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:00.471058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:00.471506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:00.656226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:00.659409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:00.664439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57fdadef-b2c3-4dd6-b686-864113d44431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215562 Sep 13 16:26:00.665112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1234/2468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:00.667534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfda04d1-d060-4342-bf97-0cbce1674b11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.209867 Sep 13 16:26:00.668026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1235/2469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:01.023830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:01.024386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:01.030949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.031429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.031554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:01.031966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.032084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:01.032525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.032969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.033397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.037871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.038356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.038798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.039529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.039992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.040420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.229513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:01.233260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:01.238404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-878483f9-629c-4796-b683-e2ea80f8c953 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218414 Sep 13 16:26:01.238992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1235/2470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:01 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:01.242618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:01.244332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:01.245498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4cc92b6-b614-4e7b-888c-389bd5a0ad69 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217871 Sep 13 16:26:01.246039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1236/2471] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:01.688605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:01.689212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:01.691454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:01.692067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:01.695441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.695915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.696335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.697016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.697461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.697879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.698629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.699139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.699572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.700251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:01.700696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:01.701116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:01.890751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:01.893834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:01.899054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efca0e22-ff61-47c5-8275-a92016744f63 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215082 Sep 13 16:26:01.899894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1236/2472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:01.902154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4e9317b-bcbf-4995-bef7-bbef7e83946d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214422 Sep 13 16:26:01.902843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1237/2473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:02.262211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:02.262821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:02.269498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.269980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.270412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.270672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:02.271120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.271328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:02.271559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.271984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.277275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.277748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.278181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.278891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.279361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.279818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.465092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:02.469053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:02.473456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-747d5919-9900-47d5-902e-93d285db9227 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215169 Sep 13 16:26:02.474030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1237/2474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:02 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:02.477538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:02.478996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:02.480143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ca6cea3-87da-45f1-b247-9217d53ff162 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213500 Sep 13 16:26:02.480683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1238/2475] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:02.922000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:02.922538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:02.925680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:02.926290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:02.928545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.929026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.929460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.930150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.930597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.931051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.932800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.933276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.933711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.934391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:02.934836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:02.935292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:02.945773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:03.121390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:03.124832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:03.129623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb14235e-a4c6-4b34-85a4-42723cccc058 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.211571 Sep 13 16:26:03.130194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1238/2476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:03.133108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-584ffae1-7ece-4bb2-a510-60fffc609f71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211271 Sep 13 16:26:03.133663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1239/2477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:03.496701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:03.497231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:03.504286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:03.504767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:03.505204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:03.505886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:03.506341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:03.506764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:03.507884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:03.508493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:03.515017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:03.515709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:03.516149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:03.516833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:03.517281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:03.517701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:03.699530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:03.706687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:03.708445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-774b956e-2deb-4a73-b159-c6191099b804 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215598 Sep 13 16:26:03.709558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1239/2478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:03 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:03.715697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:03.717181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:03.718701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8adae2f4-fcf7-423b-a119-2fcb5d407e25 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215334 Sep 13 16:26:03.719454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1240/2479] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:04.153631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:04.154241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:04.156995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:26:04.157127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f (ip 10.222.0.50) !!! Sep 13 16:26:04.158123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:04.158733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:04.165310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.165827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.166260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.167012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.167459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.167910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.168167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.168583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.169013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.169703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.170155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.171459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.183479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:04.362824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:04.366440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:04.371461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f76860e-02ac-4b93-a4aa-66208f758e63 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218119 Sep 13 16:26:04.372042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1241/2480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:04.375071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7fcb1a5-4c5f-4010-becd-6de503365e1b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.225267 Sep 13 16:26:04.375627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1240/2481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:04.731620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:04.732184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:04.738251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.738720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.739183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.739866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.740311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.740729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.743980 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:04.744717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:04.752594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.753085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.753522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.754216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:04.754797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:04.755257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:04.934422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:04.943179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5519bc3-3e7e-4481-954f-b6c0a2bbe95c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215060 Sep 13 16:26:04.943764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1242/2482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:04 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:04.945832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:04.954753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:04.956296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:04.957451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26ed50c0-91fa-4cca-9091-c3af75479044 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217279 Sep 13 16:26:04.958148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1241/2483] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:05.395687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:05.396339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:05.397460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:05.398070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:05.402780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.403315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.403752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.403864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.404343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.404490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.404781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.404942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.405388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.406202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.406655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.407105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.600519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:05.603699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:05.609506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d43a5333-d0e8-46a3-b0a3-68fbab70faba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215585 Sep 13 16:26:05.610173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1242/2484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:05.612016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08877260-ebf4-49f2-9c8d-90a088e38ada tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220246 Sep 13 16:26:05.612622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1243/2485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:05.965921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:05.966528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:05.973564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.974132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.974472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.975289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.975735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.976155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.983632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:05.984392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:05.990490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.991021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.991458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:05.992152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:05.992602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:05.993026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:06.173657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:06.177695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:06.181982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6509104c-2d80-448c-8e87-af4ba892411a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219835 Sep 13 16:26:06.182551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1243/2486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:05 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:06.186398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:06.188585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:06.189736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83a7ef3d-152b-4323-a0b3-c7887857e347 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.209999 Sep 13 16:26:06.190283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1244/2487] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:06.633305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:06.633923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:06.636179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:06.636799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:06.640617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:06.641100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:06.641564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:06.642251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:06.642704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:06.643170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:06.644135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:06.644624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:06.645065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:06.645759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:06.646215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:06.646646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:06.835073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:06.839003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:06.843957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d67f2890-c188-4008-8032-12ac3457d1cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211605 Sep 13 16:26:06.844560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1245/2488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:06.848076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46230e9a-f7d7-40ee-8deb-1ba77ad3d4d9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218531 Sep 13 16:26:06.848634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1244/2489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:07.205567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:07.206100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:07.211995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.212481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.212916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.213592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.214039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.214474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.215352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:07.215988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:07.224719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.224719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.224719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.224719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.225180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.225277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.409202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:07.415988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:07.417421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f02d3d4-92f3-4737-88d6-04b4f3f4cf45 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215789 Sep 13 16:26:07.418000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1246/2490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:07 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:07.425756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:07.427223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:07.428376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a7875df3-9905-49c0-93f1-8867cffb1ee0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216973 Sep 13 16:26:07.428921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1245/2491] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:07.867354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:07.867971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:07.870949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:07.871559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:07.874398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.874891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.875377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.876075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.876532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.876957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.877972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.878494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.878954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:07.879799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:07.880260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:07.880692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:08.075406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:08.079598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:08.083625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f138a5aa-f984-4907-8497-87fe186a2fa2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220191 Sep 13 16:26:08.084201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1247/2492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:08.087644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a83bad6c-01ae-4f6b-b4aa-e5f123fcb2d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.220437 Sep 13 16:26:08.088199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1246/2493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:08.440673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:08.441305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:08.447483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:08.447954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:08.448398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:08.449058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:08.449502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:08.449922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:08.454319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:08.455085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:08.461304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:08.461772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:08.462203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:08.462885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:08.463348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:08.463766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:08.643720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:08.646846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:08.652204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-875f17d8-4c6f-46aa-80e2-8de1fc6e7dd4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215281 Sep 13 16:26:08.652787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1248/2494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:08 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:08.655377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:08.656829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:08.657997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a663347e-49e1-48a2-9b3e-3c0a58571a22 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.208364 Sep 13 16:26:08.658697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1247/2495] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:09.107417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:09.108054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:09.111274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:09.111881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:09.115252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.115726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.116155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.116848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.117290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.117709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.117859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.118342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.118779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.119494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.119941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.120369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.309921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:09.316897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:09.318562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18f43328-fddd-43ec-99f0-a10ad337ba35 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214990 Sep 13 16:26:09.319242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1249/2496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:09.325757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb55042f-b905-44a4-b497-f7b1316e0401 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218980 Sep 13 16:26:09.326310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1248/2497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:09.676182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:09.676795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:09.682689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.683204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.683641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.684245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:09.684637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.684764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.684878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:09.685189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.691048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.691534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.691974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.692923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:09.693387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:09.693813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:09.882337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:09.886281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:09.891168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7db239c-c082-4c38-9d94-87d26521c697 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218832 Sep 13 16:26:09.891739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1250/2498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:09 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:09.895491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:09.896934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:09.898077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83034acb-478a-42d6-b4a4-64acb382eb54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217771 Sep 13 16:26:09.898616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1249/2499] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:10.345032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:10.345650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:10.348981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:10.349320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:10.353969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.354626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.355151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.355792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.356247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.356820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.356961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.357386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.357880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.358959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.359706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.360175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.554520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:10.558459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:10.563813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5dd93c3a-ae4e-46be-95a3-0d6d2bc97f57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219109 Sep 13 16:26:10.564397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1250/2500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:10.567561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3173681-a415-46dc-85a3-7a8f59d6aa7b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.228359 Sep 13 16:26:10.568384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1251/2501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:10.914051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:10.914660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:10.921523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.922123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.922560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.923288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.923743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.924048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:10.924461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.924670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:10.930592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.931104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.931542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:10.932229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:10.932680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:10.933105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:11.113746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:11.121411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:11.122153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f57c7b8-879a-4d4b-ad5d-c58aea423b86 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.211826 Sep 13 16:26:11.122736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1251/2502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:10 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:11.130353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:11.131830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:11.133181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef040fd7-ee97-46dc-bd2c-3d765185d228 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213628 Sep 13 16:26:11.133867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1252/2503] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:11.586944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:11.587559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:11.590673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:11.591345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:11.594616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:11.595140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:11.595579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:11.596270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:11.596723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:11.597149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:11.598131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:11.598613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:11.599090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:11.599781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:11.600230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:11.600654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:11.787379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:11.790542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:11.795650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-799394a0-9881-4292-bad2-23e663e6bafb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212536 Sep 13 16:26:11.797054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1252/2504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:11.799592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a85610cb-73b6-4a22-9bab-74479bf22814 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212620 Sep 13 16:26:11.800178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1253/2505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:12.145920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:12.146471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:12.152442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.152920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.153359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.154041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.154487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.154925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.159166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:12.159911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:12.165667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.166143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.166576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.167278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.167726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.168145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.349828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:12.356618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:12.358468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb83edd0-793f-4a8f-853e-4b5779086848 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216435 Sep 13 16:26:12.359589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1253/2506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:12 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:12.366315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:12.367774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:12.368922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c6843be-d184-447d-aef9-1512dca23411 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214236 Sep 13 16:26:12.369458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1254/2507] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:12.819785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:12.820321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:12.822867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:12.823538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:12.826760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.827771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.828207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.828895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.829503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.829936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.830855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.831367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.831810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:12.832509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:12.832963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:12.833422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:13.026574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:13.029261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:13.034858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f59c7255-9ee7-4860-b05a-181d8254311f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215782 Sep 13 16:26:13.035463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1255/2508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:13.037521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-680edbbd-3b76-4815-a256-b3197e416603 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.221983 Sep 13 16:26:13.038070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1254/2509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:13.381966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:13.382579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:13.388422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:13.388901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:13.389336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:13.390891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:13.391369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:13.391796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:13.394382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:13.395021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:13.400907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:13.401374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:13.401810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:13.402500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:13.402983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:13.403412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:13.406653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:13.589731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:13.594335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:13.599201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-303e4172-daa1-4aa7-b0c9-27458e041c2d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220977 Sep 13 16:26:13.599987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1256/2510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:13 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:13.603074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:13.604528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:13.605686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df403ee7-0875-4f44-8bd4-89c462325c3f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215093 Sep 13 16:26:13.606232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1255/2511] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:14.058887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:14.059535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:14.059927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:14.060744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:14.067082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.067573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.068292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.068586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.069004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.069125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.069464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.069577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.069896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.070179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.070653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.071109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.482848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:14.487452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:14.491573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-796480c9-6b83-4e2f-8875-0a86dcec3b45 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.436727 Sep 13 16:26:14.492148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1257/2512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:14 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:14.495558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-448eee6c-a4f0-4045-8394-0af23f4242ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.439707 Sep 13 16:26:14.496142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1256/2513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:14.621549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:14.622205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:14.628480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.628956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.629389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.630073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.630520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.630847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:14.631013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.631503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:14.634835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:14.637424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.637907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.638344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.639058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:14.639511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:14.639943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:14.821226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:14.825315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:14.829409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6bf6c16e-e42c-4f00-9fa3-8b863d06af44 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.211637 Sep 13 16:26:14.829977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1258/2514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:14 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:14.834359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:14.835866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:14.837084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f8f9ca8-7543-41f6-bae5-481a17c7d2ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210111 Sep 13 16:26:14.837671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1257/2515] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:15.516372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:15.517112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:15.519024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:15.519467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:15.519682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:15.525133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.525611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.525981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.526115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.526464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.526724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.526922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.527230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.527612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.527734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.528072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.528520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.715810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:15.723353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:15.724609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a3165fd-f348-4ee3-8951-313dc06f8ed1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209573 Sep 13 16:26:15.725223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1258/2516] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:15.731447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef0dd29e-e029-465e-8e22-1cbee5d1a027 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218992 Sep 13 16:26:15.732048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1259/2517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:15.853124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:15.853779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:15.860348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.860838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.861275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.861965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.862423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.862850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.864233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:15.864914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:15.871627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.872197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.872695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:15.873482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:15.874658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:15.875254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:16.062977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:16.066979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:16.071736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e36aa0f-e994-464d-8ca8-ad0ec49d2139 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222454 Sep 13 16:26:16.072305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1259/2518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:15 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:16.075719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:16.077824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:16.079018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-192f4096-fe21-4b40-bcde-50e0a46a96bd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.219633 Sep 13 16:26:16.079555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1260/2519] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:16.747890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:16.748430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:16.755374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:16.755559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:16.755993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:16.756256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:16.756385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:16.756939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:16.757385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:16.757808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:16.762509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:16.763020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:16.763456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:16.764138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:16.764654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:16.765630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:16.954084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:16.957251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:16.962299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bbf39aff-c30c-4c0b-96f1-8a492bdf7d05 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218332 Sep 13 16:26:16.962878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1260/2520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:16.966016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-687122dc-27ed-4a12-bb59-8dbac9c48c03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214172 Sep 13 16:26:16.966601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1261/2521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:17.097612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:17.098228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:17.103831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:17.104149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.104516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:17.104642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.105044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.105727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.106182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.106608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.111332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.111805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.112237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.113006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.113455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.113874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.299246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:17.303306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:17.307466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3a1c53c-c75f-4dd9-8327-027691f99468 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213701 Sep 13 16:26:17.308039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1261/2522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:17 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:17.312144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:17.313825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:17.315024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b43f91fa-9228-4c98-acb3-a2d4bd7cba8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214939 Sep 13 16:26:17.315646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1262/2523] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:17.986166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:17.986760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:17.989201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:17.989809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:17.993205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.993702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.994114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.994799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.995269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.995688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.996008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.996485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.996919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:17.997595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:17.998164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:17.998584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:18.196386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:18.199956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:18.205394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12e34d5d-8c36-4b76-88d0-16893581f8c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.223421 Sep 13 16:26:18.206049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1262/2524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:18.209236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f5b6b77-f0a6-47b8-b250-af8acd1c32e0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.223705 Sep 13 16:26:18.209785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1263/2525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:18.330930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:18.331547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:18.337460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:18.337927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:18.338355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:18.339053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:18.339496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:18.339914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:18.340753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:18.341358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:18.348156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:18.348631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:18.349062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:18.349740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:18.350187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:18.350604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:18.532391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:18.537443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:18.543105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-02ff15d1-76e6-46b4-86b3-d5f4d78f1b9c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215909 Sep 13 16:26:18.544066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1263/2526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:18 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:18.546662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:18.548184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:18.549352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff1f015d-d4c0-4c0d-9cb4-a04ee8a85247 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212514 Sep 13 16:26:18.550036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1264/2527] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:18 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:19.229788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:19.230415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:19.233446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:19.234600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:19.237791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.238282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.238726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.239455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.239914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.240346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.240921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.241403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.241839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.242527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.243074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.243503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.433146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:19.439900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:19.441522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13ca0912-f466-418b-bdda-beeb05fd5a59 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215758 Sep 13 16:26:19.442093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1264/2528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:19.448417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb1c225e-cb90-4151-81b4-43780c3499ce tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218886 Sep 13 16:26:19.448974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1265/2529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:19.566748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:19.567382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:19.573684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.574168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.574605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.575249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:19.575389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.575768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.575881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:19.576196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.582379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.582865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.583342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.584034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:19.584520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:19.584952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:19.769554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:19.776138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:19.778091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-697fd4c1-e668-4c8c-9fb2-c5214afbe095 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215101 Sep 13 16:26:19.778675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1265/2530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:19 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:19.785358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:19.786796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:19.788049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f3090d3-4d1e-4bf7-996b-f90f832e37ce tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217153 Sep 13 16:26:19.788587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1266/2531] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:20.465425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:20.466049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:20.472679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.473165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.473609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.473741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:20.474302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.474734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:20.474844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.475197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.481695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.482264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.482792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.484392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.484918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.485415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.760440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:20.768835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a75afbd1-a01c-45f9-a909-652d3a9f014f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.307208 Sep 13 16:26:20.769420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1266/2532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:20.785734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:20.793890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-080a5d81-a3ca-4748-8e08-fc19fe594922 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.324548 Sep 13 16:26:20.794456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1267/2533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:20.801981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:20.802595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:20.808660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.809036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.809478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.810166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.810615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.811067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.815912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:20.816529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:20.822606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.823150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.823598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:20.824285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:20.824739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:20.825170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:21.080933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:21.089013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f805887-a9d7-436f-9b0b-44cdaf7cf4dd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.290797 Sep 13 16:26:21.089586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1267/2534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:20 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:21.096759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:21.105639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:21.107114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:21.108267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31d638df-5a27-4426-a8a2-dbcf526d831b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.296345 Sep 13 16:26:21.109402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1268/2535] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:21.792523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:21.793154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:21.795508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=96 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:21.800979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:21.801457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:21.801887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:21.802638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:21.803200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:21.803625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:21.817522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:21.818535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:21.824980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:21.825462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:21.825900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:21.826595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:21.827080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:21.828113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:22.001773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:22.004986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:22.010086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-398eb681-38e7-41ac-809d-5bc97b2e4224 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.221384 Sep 13 16:26:22.010847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1268/2536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:22.013257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a518063-1731-438c-844e-0166a7e33463 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.199487 Sep 13 16:26:22.013818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1269/2537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:22.112639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:22.113267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:22.119296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:22.119773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:22.120209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:22.120887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:22.121336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:22.121758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:22.134226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:22.134832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:22.141337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:22.141819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:22.142282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:22.143000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:22.143473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:22.143896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:22.320770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:22.324786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:22.329746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-460274a5-da26-40c7-ab60-e202181da1e1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.221485 Sep 13 16:26:22.330328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1269/2538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:22 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:22.334269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:22.335729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:22.336863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a21ebcb9-cad2-4ad0-b69f-962c56fff6d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.206438 Sep 13 16:26:22.337401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1270/2539] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:23.034173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:23.034750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:23.036969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:23.037584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:23.041245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.041729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.042165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.042863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.043348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.043779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.044266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.044762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.045204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.045910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.047106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.047553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.239200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:23.242012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:23.248124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-054da966-07cf-44da-9207-e49d5241f832 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218379 Sep 13 16:26:23.248960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1270/2540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:23.251100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9392f480-95cd-48a8-a143-7e1da21a7a32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217845 Sep 13 16:26:23.251810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1271/2541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:23.353028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:23.353645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:23.360319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.360807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.361250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.361942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.362394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.362823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.363421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:23.364035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:23.369861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.370343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.370785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.371505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:23.371959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:23.372388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:23.552966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:23.555189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:23.556905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:23.563395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f2338f0-444d-4120-aafa-4b736f4c8619 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214035 Sep 13 16:26:23.563977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1271/2542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:23 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:23.566154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:23.567800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:23.569255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-622164b9-7dae-42fd-987b-4688543a7736 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.209828 Sep 13 16:26:23.569803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1272/2543] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:24.271947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:24.272497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:24.274269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:24.274881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:24.278806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.279311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.279748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.280958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.281410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.281588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.281827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.282067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.282500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.283216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.283667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.284094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.475496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:24.478523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:24.484128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e104b7db-bcc5-4f33-9929-882bc5d12402 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216079 Sep 13 16:26:24.484525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1272/2544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:24.494426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78b217c6-8c99-41b2-9aa4-1071fee1c71f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216499 Sep 13 16:26:24.494426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1273/2545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:24.586587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:24.587239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:24.593337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.593819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.594259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.594830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:24.594995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.595472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.595589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:24.595904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.601291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.601770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.602207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.602892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:24.603374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:24.603804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:24.788430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:24.795060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:24.796803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-91ef8388-6465-41e9-8de5-41f396c56a1f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213936 Sep 13 16:26:24.797381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1273/2546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:24 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:24.797610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:24.805547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:24.807148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:24.808308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cd85f3c-072c-45ca-91d0-0172378f15b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217340 Sep 13 16:26:24.808849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1274/2547] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:25.508670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:25.509207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:25.510815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:25.511464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:25.516157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.516639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.517071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.517755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.518050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.518205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.518531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.518640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.518992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.519689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.520140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.520571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.717533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:25.722317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:25.726799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3de466a3-13df-40d2-b388-9fd56c614d18 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222005 Sep 13 16:26:25.727606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1274/2548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:25.730840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af79f8c9-024d-4343-afa0-5922a7dafece tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.223820 Sep 13 16:26:25.731538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1275/2549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:25.820519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:25.821131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:25.826925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.827508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.828555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.829347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.829847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.830283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.833665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:25.834278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:25.848082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.848643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.849097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:25.849831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:25.850351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:25.850777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:26.245913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:26.254775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ae769c6d-f87b-4860-a81c-8699cc23939f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.438333 Sep 13 16:26:26.255376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1275/2550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:26.267330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:26.275889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:26.277327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:26.278472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97eeaf97-2a88-4f0d-a574-87d04c5acf46 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.448606 Sep 13 16:26:26.279037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1276/2551] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:26.749911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:26.750530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:26.754497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:26.755133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:26.757030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:26.757516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:26.757956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:26.758645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:26.759126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:26.759556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:26.761369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:26.761845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:26.762279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:26.762981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:26.763431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:26.763857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:26.947946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:26.954578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:26.956200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd2199be-ad91-4d9d-b5d3-d6c46e8c0815 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.210212 Sep 13 16:26:26.956783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1276/2552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:26.962775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20da3410-7e2d-4b47-8559-4ae83fbd69ad tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212072 Sep 13 16:26:26.963361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1277/2553] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:27.278202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:27.278809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:27.285550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.286032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.286467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.287174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.287627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.288051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.304548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:27.305157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:27.311191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.311696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.312450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.313225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.313675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.314100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.479128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:27.487745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3746bb33-ad24-429a-be40-db43d4145a37 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213418 Sep 13 16:26:27.488328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1277/2554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:27 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:27.490623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:27.499252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:27.500849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:27.502008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ef14a6e-007a-46ec-bff8-8564a37f8c8e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.201311 Sep 13 16:26:27.502554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1278/2555] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:27.979461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:27.980079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:27.985951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:27.987105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:27.987267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.987699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.988138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.988834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.989284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.989709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.993322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.993799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.994237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:27.994943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:27.995389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:27.995809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:28.185893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:28.189486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:28.195024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a3264de8-900a-42a6-b703-a8b34cdf3a17 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219445 Sep 13 16:26:28.195603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1278/2556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:28.198020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b51b8ef-5baa-4176-b40a-bce25bd530ea tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216476 Sep 13 16:26:28.198579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1279/2557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:28.510742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:28.511545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:28.518420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:28.518914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:28.519381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:28.520088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:28.520535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:28.520954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:28.527258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:28.527950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:28.533874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:28.534427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:28.534973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:28.535881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:28.536406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:28.536902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:28.723344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:28.729920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:28.731530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-74eebd7d-dd75-445c-86aa-2a19833a852c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.224592 Sep 13 16:26:28.732295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1279/2558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:28 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:28.738777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:28.740558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:28.741726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ef0d5e1-a81d-4948-83df-21ec1fa6ce02 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218736 Sep 13 16:26:28.742277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1280/2559] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:29.219718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:29.220428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:29.222005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:29.222628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:29.227126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.227706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.228216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.228773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.229001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.229254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.229464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.229689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.229891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.230406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.230857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.231309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.418827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:29.425587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:29.427311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01f14d4e-f534-4f61-8d73-12c9fdb52c11 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212056 Sep 13 16:26:29.427892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1280/2560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:29.433775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dba82913-3fc7-45c5-b94b-d11a5b2d1ac7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216286 Sep 13 16:26:29.434513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1281/2561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:29.754232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:29.754749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:29.760638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.761113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.761544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.762220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.762676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.763118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.768592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:29.769205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:29.775097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.775581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.776012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.776703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:29.777157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:29.777581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:29.955173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:29.963311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:29.963490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95ff28c2-a002-4b83-97c2-f6ba21f6f2e9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213734 Sep 13 16:26:29.964085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1281/2562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:29 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:29.972396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:29.973851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:29.975071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8bf70c46-817e-43f5-9c1a-7f6f5a762568 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211416 Sep 13 16:26:29.975619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1282/2563] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:30.450095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:30.450707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:30.457383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:30.457578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:30.458016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:30.458147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:30.458300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:30.459028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:30.459489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:30.459923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:30.464366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:30.464846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:30.465282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:30.465970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:30.466427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:30.466852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:30.653428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:30.656600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:30.662128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80d54e20-a8bc-4584-979f-172984554ff3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215997 Sep 13 16:26:30.662799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1282/2564] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:30.664795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21312745-170c-4333-a607-639474c24fee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211256 Sep 13 16:26:30.665344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1283/2565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:30.986947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:30.987569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:30.993491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:30.993975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:30.994417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:30.995132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:30.995587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:30.996016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.000358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:31.000968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:31.006776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:31.007281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:31.007710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.008392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:31.008838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:31.009257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.190671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:31.200134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8c50737-45d0-4246-8f23-6a6c749d2f6a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217846 Sep 13 16:26:31.200792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1283/2566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:31.201205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:31.210773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:31.212267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:31.213407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88c0138f-b4e9-4901-8a81-e38880b00ad5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216865 Sep 13 16:26:31.213958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1284/2567] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:31.685962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:31.686576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:31.688909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:31.689527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:31.693952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:31.694451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:31.694892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.695631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:31.696083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:31.696227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:31.696510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.696715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:31.697153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.697839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:31.698289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:31.698714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:31.884952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:31.892116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:31.893960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5caf697-0ec4-464b-ba2a-273ee1b0e12e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.211864 Sep 13 16:26:31.894542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1284/2568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:31.900631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00cf44b2-331a-4de3-8305-9a83f10db48c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216206 Sep 13 16:26:31.901189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1285/2569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:32.224564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:32.225173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:32.231173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.231651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.232086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.232781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.233231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.233652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.238058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:32.238670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:32.244783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.245270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.245702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.246395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.246845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.247291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.442574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:32.446176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:32.451194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce062981-7f8d-47b7-8cf6-dae4a335e66f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.230538 Sep 13 16:26:32.451855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1285/2570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:32.454997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:32.456459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:32.457636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-190023ff-ae82-4e2d-941d-54523403059b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.223479 Sep 13 16:26:32.458180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1286/2571] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:32.917547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:32.918147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:32.924904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:32.925372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.925546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:32.925675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.926088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.926769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.927246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.927669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.931919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.932402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.932839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:32.933525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:32.933974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:32.934402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:33.119444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:33.126390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:33.127867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-33133323-abfc-4e39-81e4-fb8bf869af30 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214127 Sep 13 16:26:33.128448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1286/2572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:33.135364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-733377b4-9b9d-41b0-9bfa-3eab3a2c57f6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214784 Sep 13 16:26:33.135922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1287/2573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:33.474667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:33.475309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:33.481429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:33.481916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:33.482390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:33.482866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:33.483111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:33.483501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:33.483640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:33.484049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:33.490210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:33.490702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:33.491173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:33.491875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:33.492338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:33.492801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:33.675952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:33.679020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:33.684316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5052638a-f7e5-4833-9965-4e730d793001 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213493 Sep 13 16:26:33.684887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1287/2574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:33 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:33.687812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:33.689403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:33.690556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-461f8d39-dd92-4b35-beab-33761a4a25ed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211588 Sep 13 16:26:33.691127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1288/2575] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:33 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:34.151680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:34.153776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:34.159449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.159931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.160064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:34.160477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.160600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:34.161040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.161490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.161922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.167057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.167533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.167962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.168641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.169087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.169508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.177676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:34.356350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:34.361011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:34.365123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-408ba406-2bed-47d8-89d6-64f9cbf05d57 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217301 Sep 13 16:26:34.365689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1288/2576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:34.369515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e78e552d-0dd8-4e70-906f-7152cddc3d3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214507 Sep 13 16:26:34.370075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1289/2577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:34.709459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:34.709989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:34.715712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:34.716085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.716324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:34.716559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.716989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.717663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.718108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.718521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.723005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.723489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.723930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.724619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:34.725098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:34.725628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:34.908505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:34.913434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:34.916791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e86bbe4d-d191-4b44-91b9-1242aed443e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.211188 Sep 13 16:26:34.917365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1289/2578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:34 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:34.923137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:34.924571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:34.925711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af73833f-8911-48a2-8007-83b0a38e9c5e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213932 Sep 13 16:26:34.926250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1290/2579] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:35.388002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:35.388615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:35.395117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.395607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.396042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.396730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.397183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.397605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.399810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:35.400419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:35.406713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.407301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.407757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.408445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.408895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.409313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.424601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:35.593273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:35.600862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:35.602227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9458a4a-c74c-4c10-a7c7-66efe73f87a2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218090 Sep 13 16:26:35.602805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1290/2580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:35.608946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db065874-b3c9-45df-82c2-0f63cf2bc781 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212892 Sep 13 16:26:35.609501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1291/2581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:35.938953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:35.939561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:35.946050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.946539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.947003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.947733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.948187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.948617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.950887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:35.951544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:35.958513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.959028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.959462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:35.960144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:35.960592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:35.961012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:36.145904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:36.149188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:36.154155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e4b8d1e-66f2-4ec7-bb19-7ea74992cc31 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219044 Sep 13 16:26:36.154839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1291/2582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:35 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:36.158680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:36.160263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:36.161504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb3fdd15-3583-414e-b934-2a342a1bb0ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214445 Sep 13 16:26:36.162129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1292/2583] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:36.626096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:36.626703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:36.632579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:36.633101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:36.633221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:36.633577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:36.634011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:36.634691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:36.635168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:36.635584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:36.639552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:36.640022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:36.640455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:36.642399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:36.642851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:36.643307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:36.823352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:36.830550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:36.831791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59ac432d-6bf8-4721-836c-f87432080c4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209476 Sep 13 16:26:36.832367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1292/2584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:36.838957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab6e02ee-831a-44f6-a6f9-692b0017080b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.210156 Sep 13 16:26:36.839584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1293/2585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:37.177433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:37.178047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:37.183994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.184469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.184900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.185578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.186019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.186436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.186544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:37.187173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:37.193815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.194543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.195016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.195690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.196133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.196555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.379368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:37.383139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:37.387843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25de5c25-5f07-4ccd-b772-fc6ed64b2943 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214308 Sep 13 16:26:37.388410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1293/2586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:37 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:37.392275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:37.393717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:37.394872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86394aaa-9479-4cd0-933f-f5708d6cf4a8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212168 Sep 13 16:26:37.395430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1294/2587] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:37.854690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:37.855330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:37.861633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:37.862087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.862227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:37.862418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.862857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.863575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.864033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.864461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.868706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.869183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.869621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:37.870305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:37.870752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:37.871202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:38.055811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:38.063416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:38.064595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13331c38-1fb6-4a19-9522-b3be0bca1f70 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213659 Sep 13 16:26:38.065331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1294/2588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:38.072538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45d654d5-f7b7-4e44-88fa-d8c1d251fe9b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214880 Sep 13 16:26:38.073095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1295/2589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:38.411662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:38.412285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:38.418631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:38.419149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:38.419612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:38.420142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:38.420318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:38.420748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:38.421174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:38.421527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:38.428821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:38.429303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:38.429827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:38.430582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:38.431216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:38.431642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:38.615154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:38.618722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:38.623320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6994f559-10f5-42aa-bbba-6b640fadf11c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215487 Sep 13 16:26:38.623897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1295/2590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:38 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:38.627438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:38.628949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:38.630122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5972c35-5cc3-4e72-a75d-ad5c2d14882c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213751 Sep 13 16:26:38.630674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1296/2591] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:38 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:39.089129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:39.089742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:39.095547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:39.096162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:39.096479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.096965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.097403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.098092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.098546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.098993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.102577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.103068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.103514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.104207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.104667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.105096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.291591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:39.294766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:39.299903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-189aa1a7-d281-4284-aa56-94b24a63cdc5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214554 Sep 13 16:26:39.300961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1296/2592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:39.303267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1adee4d-2bdc-4789-904a-0f036374cfc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211474 Sep 13 16:26:39.303825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1297/2593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:39 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:39.646917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:39.647633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:39.653577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.654058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.654194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:39.654494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.654673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:39.655201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.655652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.656073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.661128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.661620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.662064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.662758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:39.663247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:39.663683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:39.852580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:39.855985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:39.861447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35761a66-a9ac-491c-9b99-364793aa3d5a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218349 Sep 13 16:26:39.862020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1297/2594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:39 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:39.865715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:39.867420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:39.868585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6c2cfc3-2780-422c-aead-7e35ff1289a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218378 Sep 13 16:26:39.869222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1298/2595] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:40.324425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:40.325139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:40.327217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:40.327826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:40.332537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.333057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.333500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.334195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.334650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.335118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.335252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.335707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.336137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.336813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.337255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.337674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.528647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:40.536502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:40.537455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ae8e341-3a78-4d09-a188-54e540b98301 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216962 Sep 13 16:26:40.538029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1298/2596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:40.544861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af271e74-2cb5-4f9e-b104-425ac91df8a8 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221349 Sep 13 16:26:40.545416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1299/2597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:40.884915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:40.885557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:40.892417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.892906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.893348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.894037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.894153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:40.894489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.894662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:40.894935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.900528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.901009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.901480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:40.902174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:40.902633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:40.903098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:41.085346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:41.089112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:41.093678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a5bad28-7a5b-416e-96f7-e5024ac02ffd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.212584 Sep 13 16:26:41.094252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1299/2598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:40 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:41.097927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:41.099400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:41.100556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7c11e08-69a4-443a-b3e6-14dace6d5b35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210943 Sep 13 16:26:41.101093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1300/2599] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:41.560820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:41.561453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:41.568289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:41.568759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:41.568916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:41.569030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:41.569693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:41.570390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:41.570845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:41.571316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:41.575295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:41.575773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:41.576205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:41.576890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:41.577332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:41.577748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:41.759862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:41.767273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:41.768662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e06db15-3888-4ee4-bb5b-70de68aad1bf tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.211664 Sep 13 16:26:41.769235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1300/2600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:41.775606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b6f3dc8-146a-459e-a701-35bbaad3b38b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211069 Sep 13 16:26:41.776163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1301/2601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:42.116843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:42.117396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:42.123542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.124028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.124474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.125162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.126072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:42.126370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.126685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:42.126852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.135452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.135935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.136376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.137072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.137527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.137955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.319733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:42.322776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:42.327941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f6632cc-31e4-4f66-8b44-ed21e8b060cf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214954 Sep 13 16:26:42.328839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1301/2602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:42 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:42.331838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:42.333271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:42.334452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ae2165f-354a-4ce4-8449-5d93501720d2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212903 Sep 13 16:26:42.335184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1302/2603] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:42.791777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:42.792359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:42.798872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.799073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:42.799483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.799623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:42.799882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.800578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.801030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.801457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.805722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.806195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.806624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:42.807326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:42.807774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:42.808194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:43.007103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:43.015643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-203ef43c-8a89-475c-a15a-ba9db060baef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.227726 Sep 13 16:26:43.016274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1302/2604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:43.020513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:43.028701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9081094-2918-4106-a325-e1674ae26fbb tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.233438 Sep 13 16:26:43.029510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1303/2605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:43.352882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:43.353499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:43.360440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:43.360935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:43.361376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:43.362066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:43.362178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:43.362520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:43.362684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:43.362971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:43.368530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:43.369030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:43.369465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:43.370145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:43.370588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:43.371032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:43.553951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:43.557847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:43.562462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c87799a-317a-4567-ae25-2fae9dba41f0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213619 Sep 13 16:26:43.563861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1303/2606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:43 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:43.567187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:43.568623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:43.570029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a40e867-d303-4b82-a909-07f852f06d8d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212658 Sep 13 16:26:43.570556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1304/2607] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:44.039831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:44.040442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:44.046879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.047521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.047961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.048659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.049111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.050063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.052887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:44.053572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:44.060198 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.060811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.061482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.062472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.063116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.063656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.453105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:44.463472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d041376a-ee7b-4abf-a977-cee588bf911f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.427248 Sep 13 16:26:44.464354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1304/2608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:44.477126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:44.485610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c763ca5-02d5-48eb-b01a-cbb68a3280b9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.437375 Sep 13 16:26:44.486174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1305/2609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:44.586666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:44.587309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:44.593488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.593991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.594675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:44.594823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.595031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:44.595186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.595639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.596060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.600159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:44.600804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.601345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.601850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.602608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:44.603089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:44.603507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:44.787538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:44.790342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:44.796193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a3754867-719b-4f8d-a64f-686131dc58f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213471 Sep 13 16:26:44.796861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1305/2610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:44 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:44.799145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:44.800609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:44.801758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-718cbe1d-da2a-4a89-98d2-c759a46bdc12 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211193 Sep 13 16:26:44.802295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1306/2611] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:45.488714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:45.489310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:45.495631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.496102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.496529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.497201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.497645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.498065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.509110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:45.509722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:45.516158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.516645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.517083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.517775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.518230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.518655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.684533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:45.693282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-480a6265-5f02-4bd3-927a-77892cb8dd8d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209073 Sep 13 16:26:45.693854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1306/2612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:45.701511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:45.709635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1a7ce6c-3dba-4489-a023-02f4f7b0b56f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.204376 Sep 13 16:26:45.710187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1307/2613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:45.819857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:45.820402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:45.826456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.826641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:45.826966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.827400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:45.827540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.828095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.828746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.829059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.830307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:45.833946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.834429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.834864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.835581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:45.836028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:45.836447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:45.839534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:46.035397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:46.038311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:46.046224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe7a5078-098f-45b2-aaa8-41c5c683b08f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.230417 Sep 13 16:26:46.046802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1307/2614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:45 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:46.048789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:46.051668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:46.053494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd5b5438-a3fa-417a-92e2-91d8d274888a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.230641 Sep 13 16:26:46.054039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1308/2615] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:46.716633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:46.717180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:46.724271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:46.724754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:46.725192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:46.725875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:46.726325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:46.726746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:46.732717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:46.733473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:46.740251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:46.740727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:46.741278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:46.741970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:46.742416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:46.742836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:46.920703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:46.929132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50e0d011-df49-412b-b4f4-a966b1fb9cf7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216383 Sep 13 16:26:46.929702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1308/2616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:46.935276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:46.944736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-728bb9f0-09f5-473f-aa08-bf2a2649e51d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215585 Sep 13 16:26:46.945297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1309/2617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:47.070257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:47.070861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:47.076839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.077314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.077739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.078132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:47.079154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.079399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:47.079617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.080041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.085630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.086115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.086558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.087282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.087740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.088170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.271740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:47.275608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:47.279970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea80875e-8786-46ff-9dbf-ccc4204fa401 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213723 Sep 13 16:26:47.280530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1309/2618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:47 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:47.284439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:47.285899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:47.287101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ce1dbe4-06d4-416f-9eee-3c320f3269a1 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212720 Sep 13 16:26:47.287649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1310/2619] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:47.953189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:47.954599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:47.961037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.961513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.961947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.962656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.963129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.963554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.969075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:47.970348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:47.976638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.977116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.977549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:47.978231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:47.978679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:47.979123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:48.154888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:48.162197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:48.164242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba582637-b41a-4808-9a43-5b721359f5af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214631 Sep 13 16:26:48.164832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1310/2620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:48.171025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33894517-3256-4811-b0f1-59611f489e03 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.205650 Sep 13 16:26:48.171785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1311/2621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:48.303301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:48.303907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:48.309985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:48.310461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:48.310891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:48.311598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:48.312040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:48.312171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:48.312464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:48.312705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:48.319289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:48.320039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:48.320477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:48.321173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:48.321633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:48.322058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:48.501492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:48.510269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ffe2075-046d-4541-a4a0-8d5e603c75d6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.210741 Sep 13 16:26:48.510838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1311/2622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:48 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:48.513306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:48.522291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:48.523882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:48.525120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f9a6a6c-6a9f-4acb-aa90-ef4ab789ec4e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216929 Sep 13 16:26:48.525797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1312/2623] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:49.189040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:49.189602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:49.195443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:49.196065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:49.196285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.196771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.197208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.197900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.198351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.198782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.202434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.202943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.203422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.204826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.205279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.205714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.386347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:49.394671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57debee5-3419-4989-b3fd-626864fccfef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209988 Sep 13 16:26:49.395215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1312/2624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:49.397125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:49.405307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a5bb5aa-2bb7-44a3-9eac-15d39fd59c32 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214031 Sep 13 16:26:49.405866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1313/2625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:49.533361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:49.533915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:49.539793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.540348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.540697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.541374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.541819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.542242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.550531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:49.551157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:49.557012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.557488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.557949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.558632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:49.559109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:49.559530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:49.729204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:49.737644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b0e4c78-426d-4902-915d-0f925d12f669 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.208193 Sep 13 16:26:49.738311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1313/2626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:49 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:49.749884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:49.759345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:49.760827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:49.762015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-045dcf31-ede9-4fb0-8edf-1c2d05900048 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216524 Sep 13 16:26:49.762575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1314/2627] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:50.417520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:50.418126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:50.425711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.426194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.426624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.427338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.427782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.428208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.429157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:50.429765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:50.436636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.437125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.437566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.438909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.439402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.439830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.628666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:50.635493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:50.636935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b991aab-3f4d-45c7-a9fe-189fb59f4fda tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.223228 Sep 13 16:26:50.637504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1314/2628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:50.644163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d07db736-182d-45d6-8cf7-85342a0892c1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218772 Sep 13 16:26:50.644716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1315/2629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:50.761070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:50.761684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:50.767772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.768288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.768730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.769419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.769875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.770303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.788070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:50.788683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:50.794492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.795011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.795457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.796148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:50.796607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:50.797071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:50.950599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:50.959594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d4d86cf-e55a-4816-a2d7-41036e6aa5e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.202327 Sep 13 16:26:50.960169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1315/2630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:50 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:50.975441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:50.984165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:50.985652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:50.986791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81857a4b-3c13-4cd1-8981-2c3e20280ab7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.202540 Sep 13 16:26:50.987378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1316/2631] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:51.660353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:51.660966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:51.667440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:51.667898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:51.668289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:51.668399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:51.668551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:51.669031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:51.669479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:51.669897 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:51.675611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:51.675939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:51.676380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:51.677075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:51.677533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:51.677965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:51.863045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:51.867356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:51.871329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83d60d01-1ea4-455c-94a8-9bbf2aeb8c47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214833 Sep 13 16:26:51.871903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1316/2632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:51.876144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2dc9743-d6e9-4079-afaa-d9c0b3a75282 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211294 Sep 13 16:26:51.876702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1317/2633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:51.983178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:51.983783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:51.986355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:51.991785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:51.992256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:51.992684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:51.993357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:51.993799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:51.994216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:52.011578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:52.012194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:52.018238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:52.018724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:52.019193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:52.019886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:52.020342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:52.020774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:52.189224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:52.196609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:52.197876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c04aacec-65d0-4a66-8b25-a6d97debc62b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218459 Sep 13 16:26:52.198457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1317/2634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:51 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:52.206182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:52.207668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:52.208829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e42e78fa-6d4c-4adb-98f3-ef55f93cee01 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.201201 Sep 13 16:26:52.209529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1318/2635] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:52.896068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:52.896679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:52.899353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:52.899968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:52.903174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:52.903661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:52.904101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:52.904794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:52.905318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:52.905749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:52.906211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:52.906688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:52.907275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:52.907963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:52.908413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:52.908835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:53.100247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:53.103379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:53.108606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee3dc170-3e24-4308-8e3a-6cc3a8c96064 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217131 Sep 13 16:26:53.109285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1318/2636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:53.112236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7560df25-800c-4bb1-abc0-5cb94961a156 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216589 Sep 13 16:26:53.112802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1319/2637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:53.221545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:53.222088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:53.227993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:53.228473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:53.228911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:53.229597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:53.230048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:53.230475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:53.233771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:53.234464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:53.240915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:53.241396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:53.241833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:53.242514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:53.242991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:53.243417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:53.430012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:53.433023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:53.438821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-29351139-5391-49f1-94d2-53801e7250f9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220544 Sep 13 16:26:53.439721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1319/2638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:53 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:53.442479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:53.443944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:53.445350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec3c223a-9c87-4c17-8809-4c995caa5a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215546 Sep 13 16:26:53.445888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1320/2639] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:54.133403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:54.134521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:54.135943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:54.136583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:54.143425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.143920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.144132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.144334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.144539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.144968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.145162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.145474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.145679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.145899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.146074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.146489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.360929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:54.369531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:54.369743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9bdcb6c7-8b6c-4b72-907a-30db66bd70e1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.237324 Sep 13 16:26:54.370258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1321/2640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:54.379797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-070b2109-b6cb-424a-9e16-448b541ceb89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.251355 Sep 13 16:26:54.380369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1320/2641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:54.463201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:54.463908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:54.470534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.471171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.471417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:54.471915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.472055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:54.473564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.473564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.473935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.478070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.478530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.479016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.479713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:54.480158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:54.480587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:54.704604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:54.711423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:54.712835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7de2ed2-89fd-4f6e-b330-5deb1df2bda8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.253497 Sep 13 16:26:54.713647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1322/2642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:54 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:54.713828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:54.721535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:54.723008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:54.724168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cdd852d6-b658-454a-a49d-46c58d910fa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.258655 Sep 13 16:26:54.724716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1321/2643] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:55.395105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:55.395720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:55.402447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.402954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.403389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.403600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:55.404075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.404218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:55.404520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.404939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.410792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.411306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.411759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.412479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.412973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.413446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.599628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:55.602679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:55.607974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-14d44241-9df8-4e85-aa9b-c9b2e8606a4d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.208154 Sep 13 16:26:55.608656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1322/2644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:55.611567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf485c0a-4bc3-452a-a7dd-268b6e3f59a9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220672 Sep 13 16:26:55.612284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1323/2645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:55.736805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:55.737409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:55.743283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.743767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.744199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.744875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.745321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.745741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.748770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:55.749384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:55.755498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.755980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.756413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.757103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:55.757573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:55.757998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:55.937615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:55.944621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:55.946454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7136d107-a155-4173-9c8e-28584a957e0f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214538 Sep 13 16:26:55.947047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:26:55.947170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1323/2646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:55 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:55.955243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:55.956679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:55.957827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d488705a-e5a9-4709-ae7c-bae49818c0d9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212883 Sep 13 16:26:55.958371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1324/2647] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:56.632677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:56.633292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:56.635318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:56.635929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:56.639731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.640217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.640655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.642245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.642519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.642921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.643044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.643393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.643825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.644502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.644945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.645365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.831968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:56.840108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08404115-50ff-4ece-90f9-9ea8065e600b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.211453 Sep 13 16:26:56.840683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1324/2648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:56.842839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:56.851544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cec7b1a-1fdc-45f8-bdf4-40d2c96b7276 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219933 Sep 13 16:26:56.852096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1325/2649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:56.970253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:56.970727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:56.976707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.977205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.977642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.978330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.978785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.979238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.983345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:56.984022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:56.989909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.990387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.990826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:56.991528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:56.991976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:56.992395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:57.175732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:57.182351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:57.184187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b77f883d-c24b-4142-bc91-6bb3d60978b7 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218556 Sep 13 16:26:57.184757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1325/2650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:56 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:57.191029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:57.192455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:57.193589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9d1436e-8d06-4ce9-be9a-cfe159d997d3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214094 Sep 13 16:26:57.194126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1326/2651] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:26:57.864397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:57.865004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:57.871498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:57.871977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:57.872434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:57.873114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:57.873580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:57.874003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:57.875042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:57.876346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:57.882665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:57.883176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:57.883618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:57.884312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:57.884768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:57.885196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:58.098161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:58.102314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:58.106451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-977cc3ac-0683-43d1-9736-1cea5dd9cb81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.246495 Sep 13 16:26:58.107043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1326/2652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:58.111441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12587769-9eb7-42a4-bded-573e7b78b860 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.240159 Sep 13 16:26:58.112112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1327/2653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:58.208046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:58.208662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:58.214702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:58.215222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:58.215663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:58.216356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:58.216800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:58.217233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:58.222042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:58.222660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:58.228456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:58.228937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:58.229372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:58.230055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:58.230504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:58.230947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:58.414077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:58.417521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:58.423630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d93ac190-ce73-4f57-bdcd-fd9f7b48010d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219403 Sep 13 16:26:58.424861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1327/2654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:58 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:58.428689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:58.430133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:58.431313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b1b1adc-fcaa-4d1e-bd7b-1e9a7487b817 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215720 Sep 13 16:26:58.431852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1328/2655] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:26:59.130236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:59.130850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:59.134742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:59.135373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:59.137255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.137740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.138177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.138864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.139339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.139762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.142150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.142676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.143144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.143832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.144282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.144704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.334195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:59.338163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:59.342912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-596a0cb5-84fd-4ccd-afc4-f6020e30188e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216541 Sep 13 16:26:59.343623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1328/2656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:59.347490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22e19bfb-00a0-41c5-a262-a2d4a0c84b7c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216715 Sep 13 16:26:59.348046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1329/2657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:26:59.448783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:59.449399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:59.455998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.456443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:26:59.456595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.456910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.457052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:26:59.457600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.458058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.458486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.462840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.463354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.463792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.464477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:26:59.464927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:26:59.465354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:26:59.646073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:59.654336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8265f3e-3f56-46e1-b5b3-e4909d115288 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.209388 Sep 13 16:26:59.654719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1329/2658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:26:59 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:26:59.656910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:59.665476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:59.666950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:26:59.668130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82e1a864-5b6b-41ed-8a65-6694e8866e4b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215998 Sep 13 16:26:59.668656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1330/2659] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:26:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:00.367244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:00.367871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:00.371156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:00.371773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:00.374261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.374742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.375208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.376630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.377082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.377504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.378030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.378509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.378974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.379667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.380120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.380544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.565268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:00.573782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4df2a376-a491-456e-b4af-ac79efc90d28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.210254 Sep 13 16:27:00.574245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1330/2660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:00.576745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:00.585347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-178e3819-c5c9-47e7-ac41-218a5838f65a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218147 Sep 13 16:27:00.585894 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1331/2661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:00.677221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:00.677755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:00.683721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.684176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.684605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.685273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.685717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.686131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.693088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:00.693686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:00.699726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.700208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.700637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:00.701316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:00.701763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:00.702188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:01.094996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:01.103466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-17f724c6-d937-4a1b-a51a-eda2424fad21 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.430051 Sep 13 16:27:01.104043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1331/2662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:00 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:01.116670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:01.125809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:01.127359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:01.128514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd23919d-4e31-46e3-aa78-dc78e3da94ae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.439276 Sep 13 16:27:01.129065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1332/2663] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:01.596820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:01.597417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:01.603842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:01.604318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:01.604749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:01.605430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:01.605875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:01.606301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:01.609261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:01.611097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:01.616880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:01.617366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:01.617805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:01.618496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:01.618996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:01.619407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:01.796379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:01.800916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:01.805258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df4e5efe-b3f2-4df3-9316-285605b465db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212445 Sep 13 16:27:01.805844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1332/2664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:01.809252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b1d8f09-96f6-4a6c-b8d3-151928686236 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.203908 Sep 13 16:27:01.809821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1333/2665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:02.126572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:02.127212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:02.133167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.133647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.134082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.134763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.135239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.135662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.153619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:02.154225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:02.161072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.161546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.161982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.162731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.163207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.163628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.334394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:02.338608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:02.342561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-555dc507-9c74-4691-b632-f79d8db1c739 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220077 Sep 13 16:27:02.343159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1333/2666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:02 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:02.348041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:02.349481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:02.350622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d3ae67a-c910-4a25-ac63-f7ed8a66dacc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.200939 Sep 13 16:27:02.351179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1334/2667] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:02.829346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:02.830035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:02.833759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:02.834370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:02.836362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.836844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.837281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.837976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.838430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.838855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.840530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.841173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.841459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:02.842144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:02.842591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:02.843036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:03.033267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:03.038324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:03.042428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4104dd48-0c05-41e6-9c7f-bdbf62911e01 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216658 Sep 13 16:27:03.048456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db94d4e2-ce65-4f48-84ce-c47177974573 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218285 Sep 13 16:27:03.049299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1335/2668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:03.058233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1334/2669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:03.366736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:03.367388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:03.373332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:03.373812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:03.374249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:03.374951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:03.375592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:03.375984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:03.376166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:03.376618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:03.382437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:03.382941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:03.383380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:03.384061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:03.384511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:03.384935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:03.564912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:03.568688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:03.573661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-287afc30-7180-4365-b38e-add3ec1ab764 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.210709 Sep 13 16:27:03.574229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1336/2670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:03 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:03.577439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:03.579016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:03.580178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d41a36c-5e97-4884-863d-292fcc77ecba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.208000 Sep 13 16:27:03.580724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1335/2671] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:04.066021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:04.066652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:04.072844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:04.073440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.073578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:04.073922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.074363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.075231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.075688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.076115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.080472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.080953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.081394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.082087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.082537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.082989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.267191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:04.275481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0f61e3d-fb71-4ef4-90dd-eb2d1791e34b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213879 Sep 13 16:27:04.276060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1337/2672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:04.278138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:04.286770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48d8af51-15ae-4f60-978a-5dd90c7c42c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217999 Sep 13 16:27:04.287348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1336/2673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:04.596862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:04.597507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:04.603588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.604069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.604504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.605187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.605398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:04.605643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.606003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:04.606110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.612578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.613052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.613483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.614159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:04.614603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:04.615045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:04.796258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:04.804371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:04.805223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbc50e93-6af8-4f4b-b66e-b395da85035e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.212498 Sep 13 16:27:04.805795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1338/2674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:04 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:04.812956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:04.814383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:04.815570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6d2b33c-c0e1-4800-bbb8-3c8a4cdcb79d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213974 Sep 13 16:27:04.816117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1337/2675] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:05.298572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:05.299208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:05.305850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.306326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.306756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.307474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.307921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.308335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.310468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:05.311109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:05.317276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.317686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.318117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.318810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.319264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.319679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.335087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:05.491241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:05.499315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e44051d2-62e5-45c2-a067-4322b7f119ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.204991 Sep 13 16:27:05.499880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1339/2676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:05.502760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:05.510999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-526af6d1-3e88-4e44-b8ab-9f4230f0e802 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.204264 Sep 13 16:27:05.511543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1338/2677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:05.828333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:05.829684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:05.835669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.836153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.836589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.837284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.837734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.838158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.839864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:05.840478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:05.846575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.847102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.847541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:05.848233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:05.848683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:05.849106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:06.033820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:06.037877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:06.042224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e22b19ed-2de1-4d0f-b3d8-eb21b445140c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217636 Sep 13 16:27:06.043020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1340/2678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:05 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:06.046670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:06.048834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:06.049991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4072550d-b415-4b5f-baa8-0d2e1ec821cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213940 Sep 13 16:27:06.050532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1339/2679] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:06.521517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:06.522052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:06.528294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:06.528768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:06.529200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:06.529877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:06.530322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:06.530743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:06.535031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:06.535649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:06.541946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:06.542426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:06.542851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:06.543555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:06.544002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:06.544420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:06.546159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:06.729013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:06.735737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:06.737664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce9bc7c4-402d-4333-85f6-ba43feaa047a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219967 Sep 13 16:27:06.738320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1341/2680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:06.743906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37cd86cd-d312-4051-afcb-6fcddad418d2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213941 Sep 13 16:27:06.744467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1340/2681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:07.066245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:07.066858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:07.073178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.073660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.074096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.074783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.075260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.075691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.075814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:07.076399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:07.083449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.083936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.084377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.085071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.085526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.085954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.272150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:07.278205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:07.284804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:07.286230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:07.286574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d107a5e9-2584-4338-8aad-dcc8a511adb6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.224754 Sep 13 16:27:07.287387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1342/2682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:07 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:07.287540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebf299ba-c033-4da4-ab99-4cc77de9ad8c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215518 Sep 13 16:27:07.288212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1341/2683] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:07.761479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:07.762093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:07.767075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:07.767691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:07.768615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.769110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.769544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.770235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.770692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.771162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.773845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.774315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.774744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.775444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:07.775887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:07.776305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:07.964142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:07.968110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:07.973067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b731c8cd-d4c0-4be0-b9a2-f98b85d8b378 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.210266 Sep 13 16:27:07.973632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1342/2684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:07.977076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07d749b1-426d-4c0a-8dac-1aa533fbd4d4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219434 Sep 13 16:27:07.977633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1343/2685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:08.309036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:08.309643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:08.316138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:08.316622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:08.317080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:08.317768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:08.318212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:08.318634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:08.426975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:08.427586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:08.438658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:08.439472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:08.440136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:08.440880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:08.441335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:08.441758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:08.461646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:08.479795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a66f5d65-a10e-4dd8-bed3-22eb845c426c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.174486 Sep 13 16:27:08.480457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1343/2686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:08 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:08.576925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:08.586084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:08.587589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:08.588744 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4747113e-1958-47af-a76d-7f2cbc279bbe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.279858 Sep 13 16:27:08.589296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1344/2687] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:08 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:08.997112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:08.997676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:09.002300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:09.003030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:09.005062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.005541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.005974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.006654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.007129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.007548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.009350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.009835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.010274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.010984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.011441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.011872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.198668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:09.201778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:09.207426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f375fc7f-e4b7-48c4-bbd9-ef8bf91fa51c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214174 Sep 13 16:27:09.208113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1344/2688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:09.209950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8297c151-d1da-40a0-853e-08a3fdb6e570 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212200 Sep 13 16:27:09.210507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1345/2689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:09.503214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:09.503829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:09.509833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.510309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.510748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.511494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.511950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.512372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.614162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:09.614769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:09.620793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.621312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.621755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.622486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:09.622964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:09.623417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:09.639641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:09.648283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aec0f347-bcac-4d38-8602-ec121ac16d8a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149093 Sep 13 16:27:09.648853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1345/2690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:09 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:09.752182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:09.760644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:09.762090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:09.763278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27794fed-421a-48a8-9f77-9005bdd347c9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153608 Sep 13 16:27:09.763840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1346/2691] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:10.232075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:10.232685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:10.234787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:10.235982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:10.238917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.239407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.239836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.240518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.240963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.241384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.242727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.243253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.243705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.244408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.244903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.245346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.434442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:10.437615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:10.442835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9de13fbb-328c-41ac-85f7-78cb5840ccf9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214687 Sep 13 16:27:10.443446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1346/2692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:10.446708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ff56e0a-206b-44ba-8ccb-e7a1144a32af tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215875 Sep 13 16:27:10.447300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1347/2693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:10.672032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:10.672564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:10.678891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.679390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.679820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.680494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.680938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.681355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.788868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:10.789597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:10.795514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.795998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.796433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.797118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:10.797570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:10.797995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:10.808658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:10.818129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cfb7f995-6977-4ee7-b592-456aa154ca75 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149931 Sep 13 16:27:10.819060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1347/2694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:10 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:10.929653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:10.938887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:10.940357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:10.941506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bf1eeb4-a56c-4b89-8643-d0a0a1ac2a76 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156545 Sep 13 16:27:10.942061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1348/2695] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:11.467547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:11.468168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:11.472443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:11.473054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:11.475002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.475484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.475914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.476638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.477078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.477495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.479423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.479904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.480346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.481032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.481483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.481906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.669606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:11.673729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:11.678584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a292dea-df20-438d-8a87-b8ac6826e753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215164 Sep 13 16:27:11.679300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1348/2696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:11.682004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98aa658a-af48-4179-9d4c-17714cbb231b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214090 Sep 13 16:27:11.682599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1349/2697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:11.842839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:11.843495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:11.849528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.850010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.850448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.851167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.851619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.852064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.967405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:11.968010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:11.974294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.974775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.975242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.975939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:11.976379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:11.976826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:11.978308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:11.987134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd0dfef4-7650-47c2-a82e-4142ec6b5cee tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.148033 Sep 13 16:27:11.987738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1349/2698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:11 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:12.102573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:12.111696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:12.113163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:12.114299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c50ccf05-947b-4526-8109-5f52ad955521 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.150864 Sep 13 16:27:12.114848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1350/2699] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:12.702260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:12.703146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:12.707144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:12.707755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:12.710099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:12.710587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:12.711063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:12.711761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:12.712213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:12.712739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:12.714537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:12.715091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:12.715561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:12.716251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:12.716702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:12.717128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:12.888705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:12.898650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a80b6d37-bb04-4c50-8e9a-98cfb5640f12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.200297 Sep 13 16:27:12.899336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1350/2700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:12.939045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:12.947528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3135360e-6f37-43dc-a8f9-a69b927b4333 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.244889 Sep 13 16:27:12.948104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1351/2701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:13.009572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:13.010178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:13.016768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.017468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.017903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.018579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.019053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.019473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.140490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:13.141741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:13.147589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.148071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.148500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.149214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.149375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:13.149660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.150080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.157589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4700fa6e-aca8-4857-a1fc-35975860d362 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151877 Sep 13 16:27:13.158158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1351/2702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:13 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:13.275984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:13.284498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:13.285938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:13.287119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-093ad92f-6ac1-46b8-81d9-cd940f294eae tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.150496 Sep 13 16:27:13.287679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1352/2703] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:13 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:13.923690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:13.924302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:13.930652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.931160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.931598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.932277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.932724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.933146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.971862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:13.972496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:13.978952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.979437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.979869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:13.980556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:13.981001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:13.981420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:14.117290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:14.121342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:27:14.121593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f (ip 10.222.0.50) !!! Sep 13 16:27:14.125946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2405e6f6-4f14-44fb-a128-b638c8da5bc0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.206450 Sep 13 16:27:14.126607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1352/2704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:14.145497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:14.153621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5aaa197c-043c-45d3-8634-6c7b8808db1d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.186428 Sep 13 16:27:14.154182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1353/2705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:14.180704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:14.181354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:14.187240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:14.187724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:14.188283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:14.189075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:14.189564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:14.189992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:14.312251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:14.312882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:14.318823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:14.319337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:14.319689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:14.319864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:14.320702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:14.321152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:14.321572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:14.329006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cec66a5a-da0a-4e89-a633-6b22071329af tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151530 Sep 13 16:27:14.329715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1353/2706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:14 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:14.452380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:14.462005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:14.463604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:14.464988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b24ea590-fd51-42b1-9545-4c3248c166cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156549 Sep 13 16:27:14.465651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1354/2707] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:15.150164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:15.150786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:15.157200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.157676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.158115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.158789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.159264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.159687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.177704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:15.178339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:15.184842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.185327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.185876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.186571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.187055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.187486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.356238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:15.361789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:15.365243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7cf23419-35bc-47db-b907-c417bbcb3493 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218995 Sep 13 16:27:15.365803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1354/2708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:15.370163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c655234d-ca74-4b76-bc04-454611f7bf33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.196212 Sep 13 16:27:15.370320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:15.370856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1355/2709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:15.371016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:15.376914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.377396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.377830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.378515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.378989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.379414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.381909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:15.491592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:15.492312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:15.498189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.498740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.499286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.500037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:15.500673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:15.501169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:15.507865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:15.515990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aaaa320d-9ce1-439b-b479-401ba25b4582 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149243 Sep 13 16:27:15.516557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1355/2710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:15 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:15.629841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:15.638371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:15.639855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:15.641528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9919d465-0816-4798-8338-f2b87f8e3ded tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153331 Sep 13 16:27:15.642128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1356/2711] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:16.388886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:16.389527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:16.394338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:16.394971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:16.395958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.396439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.396877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.397262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:16.397563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.398009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.398472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.402786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.403404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.403928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.404665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.405124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.405559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.590866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:16.595233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:16.599553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e3eaa14f-edab-4962-8029-8c866720f565 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214493 Sep 13 16:27:16.600249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1356/2712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:16.603649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cad5baf-55c7-483b-a8f4-8a23fd4d3a33 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213310 Sep 13 16:27:16.604396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1357/2713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:16.605453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:16.606068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:16.612940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.613433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.613869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.614565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.615047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.615478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.667489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:16.668043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:16.674776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.675284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.675717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.676400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:16.676844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:16.677261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:16.681176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:16.782817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:16.791268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c39b5de1-81cb-419c-973c-aed58bb042bf tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.190035 Sep 13 16:27:16.792157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1357/2714] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:16 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:16.826443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:16.835788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:16.837240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:16.838400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-782bb701-a0fe-42b3-9b79-b1e8ab6d6506 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.174851 Sep 13 16:27:16.838977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1358/2715] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:17.625160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:17.626383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:17.628506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:17.629208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:17.633165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.633657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.634092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.634798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.635274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.635703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.635952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.636473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.636917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.637619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.638075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.638733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.829347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:17.833201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:17.837694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b09c432-3b77-4432-8df8-40eb10092736 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213883 Sep 13 16:27:17.838263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1359/2716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:17.841581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18eab024-8624-4028-b953-1be41508a4ae tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220432 Sep 13 16:27:17.842348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1358/2717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:17.842608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:17.843241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:17.849166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.849651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.850088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.850770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.851252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.851678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.864539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:17.865146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:17.871017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.871502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.871936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:17.872619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:17.873072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:17.873496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:18.034074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:18.042302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c39a4e5-c254-4ecd-bbde-86f01cbc8812 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.203063 Sep 13 16:27:18.043080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1360/2718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:17 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:18.055964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:18.065436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:18.067003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:18.068161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d4205c8-403d-462a-88d1-3d10c895aaa9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.207553 Sep 13 16:27:18.068875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1359/2719] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:18.861400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:18.862032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:18.864499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:18.865113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:18.868528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:18.869004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:18.869432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:18.870114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:18.870566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:18.871180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:18.871726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:18.872209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:18.872647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:18.873474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:18.873795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:18.874219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:19.064635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:19.071762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:19.073395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0cb0a5da-38e7-4cbf-ae8a-ecce6e80956e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215948 Sep 13 16:27:19.073973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1361/2720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:19.078351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:19.079901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:19.080868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5f27f26-58a1-47e3-a257-1f602bc4d249 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220151 Sep 13 16:27:19.092531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1360/2721] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:19.092693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:19.092693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:19.092693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:19.092693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:19.093099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:19.093099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:19.097215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:19.097832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:19.103624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:19.104105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:19.104537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:19.105221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:19.105855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:19.106278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:19.281420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:19.290229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7ebedd6-4347-4746-9b77-3bd6e1585b1d tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215240 Sep 13 16:27:19.291129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1362/2722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:19 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:19.293586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:19.302742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:19.304416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:19.305568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c0e1e11-5feb-44fb-89b2-7dd3c5bf2cdb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212101 Sep 13 16:27:19.306117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1361/2723] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:20.096918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:20.097584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:20.104121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.104610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.105187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.105734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.106200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:20.106846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:20.111652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.112108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.114148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.114633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.115296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.116159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.116451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.116874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.306521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:20.308862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:20.316966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18f991a9-10d2-4157-a6e3-c3fff40fd91d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.223811 Sep 13 16:27:20.317461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1363/2724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:20.317867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c4bdbfa-5e4b-4dc0-bc5a-d1e1c5ed11bd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215801 Sep 13 16:27:20.318648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1362/2725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:20.322065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:20.322663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:20.329065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.329843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.330285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.330978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.331432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.331854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.334187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:20.334794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:20.341791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.342276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.342717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.343470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:20.343933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:20.344425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:20.752659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:20.755714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:20.761355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8eea7a46-d305-44a4-89cb-2f5aa2798593 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.442643 Sep 13 16:27:20.761680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1364/2726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:20 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:20.764335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:20.765770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:20.766991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6964fa84-3d5a-40c3-8fbd-7c039354d22e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.439876 Sep 13 16:27:20.767533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1363/2727] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:21.341508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:21.342118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:21.343701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:21.344365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:21.349175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.349660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.350099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.350823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.350973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.351308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.351454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.351733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.351953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.352657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.353113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.353570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.615427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:21.623569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84eed356-758d-4802-9e1d-b9a8091e42dc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.285838 Sep 13 16:27:21.624141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1365/2728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:21.626664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:21.635564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57b79f5b-d629-4fb1-a3c5-b175eacecdea tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.295454 Sep 13 16:27:21.636129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1364/2729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:21.785006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:21.785638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:21.791593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.792072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.792318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:21.792508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.793093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:21.793224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.793629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.794047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.801331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.801886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.802439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:21.803426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:21.803955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:21.804453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:22.083531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:22.091912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-778cb68b-312f-4adf-a624-af39c94c2587 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.311557 Sep 13 16:27:22.092576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1366/2730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:21 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:22.102930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:22.111909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:22.113422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:22.114592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-468487a5-cdcd-45b4-9083-3d983e7b33f3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.326303 Sep 13 16:27:22.115205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1365/2731] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:22.646986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:22.647608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:22.654265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:22.654747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:22.655229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:22.655923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:22.656380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:22.656993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:22.658936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:22.659744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:22.661994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:22.667243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:22.667720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:22.668150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:22.668830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:22.669276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:22.669697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:22.848611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:22.855474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:22.856809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ee513b1-c8a2-412f-8965-4928a0827fd2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213811 Sep 13 16:27:22.857392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1367/2732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:22.864483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48c6ff4f-272f-449e-9e9e-375502563cd3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.209354 Sep 13 16:27:22.865086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1366/2733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:23.115549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:23.116165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:23.122023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.122500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.122972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.123662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.124117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.124548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.140561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:23.141679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:23.147864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.148352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.148786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.149471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.149921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.150345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.313107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:23.321524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e32c117-f482-4d3c-b48e-29fb013bdaac tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.209451 Sep 13 16:27:23.322012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1368/2734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:23 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:23.327757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:23.337070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:23.338524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:23.339701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84e5657c-ab9a-4836-b189-94ed0740e4cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.202949 Sep 13 16:27:23.340263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1367/2735] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:23 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:23.881069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:23.881683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:23.887475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:23.888079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:23.888249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.888738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.889178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.889872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.890326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.890746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.896217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.896217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.896217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:23.896568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:23.897013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:23.897433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:24.086848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:24.093651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:24.096022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32e8745c-0db5-4c54-bc8e-40386c4f8a95 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218793 Sep 13 16:27:24.096606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1369/2736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:24.102474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd765508-c0c5-4688-b587-06bd612c31f2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218737 Sep 13 16:27:24.103098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1368/2737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:24.345257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:24.345872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:24.352086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:24.352559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:24.352994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:24.353673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:24.354150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:24.354570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:24.365240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:24.365845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:24.371665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:24.372139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:24.372567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:24.373248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:24.373692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:24.374114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:24.554210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:24.558139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:24.562596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b15aec94-f9f9-4c30-b49e-8a07387d7da4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.221835 Sep 13 16:27:24.563441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1370/2738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:24 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:24.567377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:24.568814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:24.569957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47c25706-a454-4f70-9a8a-cb68a5d6c444 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.208554 Sep 13 16:27:24.570492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1369/2739] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:25.119438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:25.120082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:25.125159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:25.125771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:25.127061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.127549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.127989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.128677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.129135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.129558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.132017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.132502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.132936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.133625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.134099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.134532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.320620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:25.324288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:25.329254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-557d4245-ed6e-4945-8407-724b7c3d7946 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213606 Sep 13 16:27:25.329835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1371/2740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:25.333351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8787dc1f-7266-4f9b-b742-4f5895216ee5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.211913 Sep 13 16:27:25.333912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1370/2741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:25.585773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:25.586388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:25.592277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.592757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.593187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.593865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.594928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.595364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.596039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:25.596653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:25.602590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.603113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.603554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.604238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:25.604691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:25.605117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:25.789812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:25.793749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:25.796029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:25.798472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b90744d2-0466-4454-bb4e-03a72f038218 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216249 Sep 13 16:27:25.799088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1372/2742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:25.803955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:25.805397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:25.806552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e094781-8156-4c63-9683-886c057acaec tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215032 Sep 13 16:27:25.807127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1371/2743] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:26.353518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:26.354152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:26.356201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:26.356838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:26.361349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.361807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.362237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.362943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.363392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.363814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.364384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.364869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.365306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.365998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.366451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.366873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.558485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:26.562343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:26.567082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-097ba29d-5d38-4fbc-894a-4b5a233bd4e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.217332 Sep 13 16:27:26.567657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1373/2744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:26.571596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7dd45f8-6190-4bb3-882e-ae1e4550a77c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219249 Sep 13 16:27:26.572338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1372/2745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:26.821882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:26.822418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:26.828657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.829136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.829578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.830263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.830716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.831168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.831942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:26.832557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:26.838498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.839010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.839449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:26.840136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:26.840587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:26.841012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:27.012761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:27.014958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:27.023094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13f0824c-8c73-497b-b12c-2f4898a565b9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.205190 Sep 13 16:27:27.023716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1374/2746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:26 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:27.024068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:27.033435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:27.034908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:27.036086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c20a28cb-2c42-4714-a1cc-387ef6a95934 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.207992 Sep 13 16:27:27.036634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1373/2747] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:27.591068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:27.591683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:27.594339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:27.595016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:27.598357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:27.598840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:27.599305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:27.599997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:27.600450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:27.600872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:27.601171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:27.601686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:27.602124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:27.602807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:27.603279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:27.603714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:27.795024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:27.799104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:27.808353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a16bf9d1-d63b-4ad3-9407-64eae7d55cf8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217754 Sep 13 16:27:27.808921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1374/2748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:27.810257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9498774-4a97-4c25-bc93-3ac8d04200cf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.222949 Sep 13 16:27:27.811049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1375/2749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:28.047117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:28.047730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:28.054422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.054928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.055382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.056076 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.056532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.056966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.062171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:28.062171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:28.068325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.068820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.069257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.069973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.070429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.070855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.254297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:28.258218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:28.262921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9f81344-8d50-4234-ae27-1e2e693cd229 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219584 Sep 13 16:27:28.263637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1375/2750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:28 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:28.266992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:28.268431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:28.269585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-353f6be9-8400-4a1d-9b99-c2015d8d362a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212881 Sep 13 16:27:28.270129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1376/2751] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:28 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:28.834955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:28.835576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:28.844989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:28.845606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:28.849278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.849771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.850216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.850952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.851413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.851842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.857539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.858287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.858729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:28.859650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:28.860367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:28.860850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:29.048851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:29.053167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:29.057087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25663b9c-9d93-4610-b80a-2f4b44e2060e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.225899 Sep 13 16:27:29.066881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1377/2752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:29.067658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-415fb31d-26fd-411d-b3dd-e23b42f63391 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.232435 Sep 13 16:27:29.067658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1376/2753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:29.286353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:29.286893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:29.293107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:29.293668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:29.293804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:29.293911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:29.294304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:29.294504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:29.294990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:29.295423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:29.301134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:29.301613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:29.302045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:29.302728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:29.303198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:29.303815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:29.488273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:29.492283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:29.496681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8284fed7-2e75-4e23-9d9d-0f65767d5a59 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214886 Sep 13 16:27:29.497326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1378/2754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:29 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:29.500775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:29.502744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:29.503918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c788e416-afa1-46a1-b78f-b462db4b7a35 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214040 Sep 13 16:27:29.504463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1377/2755] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:30.082888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:30.083520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:30.085869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:30.086478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:30.089903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.090449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.090885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.091593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.092036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.092477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.092914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.093395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.093831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.094513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.095723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.096155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.285126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:30.288428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:30.293662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e37f30b-3230-49d8-836e-5373a1fc8214 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215476 Sep 13 16:27:30.294352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1379/2756] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:30.298598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58e7fbea-a5e3-4df7-ae9c-b40e3a54f011 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216509 Sep 13 16:27:30.299287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1378/2757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:30.519955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:30.520570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:30.526620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.527139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.527573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.528253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.528699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.528813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:30.529121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.529388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:30.536243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.536716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.537150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.537826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:30.538270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:30.538690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:30.723052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:30.726198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:30.731206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f70aa63c-17d9-4092-9fab-0dba4bb7d957 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215089 Sep 13 16:27:30.731773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1380/2758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:30.735021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:30.737130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:30.738349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c65633e-a9e8-4ee1-a396-9ec172731112 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213348 Sep 13 16:27:30.738983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1379/2759] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:31.318587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:31.319225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:31.321965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:31.322599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:31.326125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.326615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.327074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.327829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.328308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.328830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.330488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.331341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.331842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.332650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.333171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.333839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.516521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:31.524999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe681857-cdd7-4c54-9740-081cb93b5532 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.210833 Sep 13 16:27:31.525374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1381/2760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:31.527682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:31.536043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26308c37-7a01-4803-a751-dffcf5f38c7c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218542 Sep 13 16:27:31.536706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1380/2761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:31.753390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:31.754001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:31.759954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.760434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.760868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.761556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.762007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.762281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:31.762427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.762893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:31.769029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.769513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.770067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.770753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:31.771267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:31.771695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:31.950188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:31.958440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f052c547-8273-4c5b-89f8-80122e294d93 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.208860 Sep 13 16:27:31.959040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1382/2762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:31 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:31.964699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:31.974005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:31.975496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:31.976655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-555094a1-fb00-4341-ba26-2c39a158837e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218312 Sep 13 16:27:31.977209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1381/2763] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:32.548243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:32.549102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:32.555833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:32.556320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:32.556771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:32.557468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:32.557925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:32.558357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:32.558832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:32.559468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:32.566590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:32.567122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:32.567559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:32.568245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:32.568690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:32.569112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:32.973873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:32.978125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:32.983215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9d04ece-38e4-4775-8527-3f5df6845674 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.438864 Sep 13 16:27:32.983822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1383/2764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:32.989057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:32.989240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c87ccc4-f140-4970-b042-3b11b8974ea1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.434087 Sep 13 16:27:32.989660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:32.990151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1382/2765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:32.995486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:32.995962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:32.997956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:32.998652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:32.999137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:32.999574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:33.005126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:33.005993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:33.011822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:33.012296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:33.012729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:33.013416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:33.013867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:33.014320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:33.187950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:33.197714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f8b4cdd-4455-494c-bad8-eea9d7742e0e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.212820 Sep 13 16:27:33.198292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1384/2766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:33.201396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:33.211090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:33.212596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:33.213826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a47dc058-e53d-4c5c-bde5-9afb3e689653 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213319 Sep 13 16:27:33.214383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1383/2767] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:34.007363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:34.007966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:34.012475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:34.013178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:34.014273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.014970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.015409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.016094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.016977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.017955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.019636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.020121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.020558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.021243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.021694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.022117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.214787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:34.218223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:34.223899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02e3b032-e6aa-40bf-9c8c-61e3b152632e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220314 Sep 13 16:27:34.224479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1385/2768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:34.227079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b84707a8-5e7a-4f05-a62d-a3f30a9205f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218269 Sep 13 16:27:34.227795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1384/2769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:34.228863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:34.229467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:34.235435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.236590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.237038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.237726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.238179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.238604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.240208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:34.241216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:34.247931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.248413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.248848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.249538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:34.249989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:34.250412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:34.431622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:34.434883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:34.440081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0009053-7654-4df9-80a9-0a4ec03a29fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214560 Sep 13 16:27:34.440737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1386/2770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:34 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:34.444357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:34.445884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:34.447407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46f738ca-dd16-4b39-9dba-7ce762ebb8d7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213477 Sep 13 16:27:34.448033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1385/2771] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:35.249646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:35.250307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:35.250578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:35.251253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:35.257499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.257979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.258107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.258414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.258589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.259066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.259181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.259569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.259758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.259997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.260220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.260648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.450122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:35.453185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:35.458881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c67dd9f-e79a-455e-b5ab-6e9d8a0b7b44 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213123 Sep 13 16:27:35.459497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1387/2772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:35.461300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c48f03d1-bbac-491a-8351-3f4580365959 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214450 Sep 13 16:27:35.462007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1386/2773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:35.463942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:35.464611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:35.471431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.471913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.472356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.473059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.473506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.474060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.482503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:35.483154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:35.489622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.490103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.490538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.491272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:35.491722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:35.492149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:35.669901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:35.675098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:35.679075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37c228f0-9b0f-4b2f-83ae-a5017955b57b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218565 Sep 13 16:27:35.679650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1388/2774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:35 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:35.683798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:35.685233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:35.686376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5df5279-d470-4d93-9336-92d34b123ce5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.207607 Sep 13 16:27:35.686926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1387/2775] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:36.483247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:36.483850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:36.485058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:36.486423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:36.491482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.491958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.492384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.492769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.493066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.493258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.493515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.493699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.493935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.494386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.494839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.495290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.510149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:36.686760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:36.691007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:36.695767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe578a3c-a388-4d14-aab0-e1ae2f427fc5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216435 Sep 13 16:27:36.696616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1389/2776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:36.699551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ae89c5c9-3725-465c-be62-617d06fbadc4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218216 Sep 13 16:27:36.712081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1388/2777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:36.712264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:36.712264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:36.712264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.712264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.712610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.712610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.712610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.712610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.712929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:36.712929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:36.718813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.719326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.719756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.721081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:36.721563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:36.722030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:36.904735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:36.907802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:36.913070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8c2bf35-eed2-44a9-8b18-3c5487413425 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215186 Sep 13 16:27:36.913650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1390/2778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:36 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:36.916647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:36.918109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:36.919286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57844ffe-0b4a-4bd0-bc02-3141c7af1ce4 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211072 Sep 13 16:27:36.919822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1389/2779] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:37.718854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:37.719479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:37.722638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:37.723277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:37.726291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.726763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.727224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.727902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.728346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.728855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.729560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.730038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.730473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.731186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.731634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.732064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.743791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:37.921715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:37.925761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:37.930750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4b43dc7-524d-4fac-ab91-fab87c91f8d9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215663 Sep 13 16:27:37.931439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1391/2780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:37.936403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:37.937018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:37.937385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26462192-5d9e-4a54-9ba9-70a8ad9a2be7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218471 Sep 13 16:27:37.938151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1390/2781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:37.943718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.944449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.945117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.945721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:37.946468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.946799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:37.947320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.947932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.953026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.953512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.953950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:37.955280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:37.955736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:37.956162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:38.148692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:38.155324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:38.156867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4f8b0187-f660-4ebb-aa2a-2220971c8f49 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.224031 Sep 13 16:27:38.157445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1392/2782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:37 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:38.164389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:38.165833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:38.167016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-919917a0-053f-4583-84c6-1c1ab0fd23fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.225245 Sep 13 16:27:38.167562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1391/2783] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:38.957725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:38.958337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:38.961812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:38.962621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:38.964916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:38.965419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:38.965850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:38.966532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:38.967004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:38.967462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:38.969130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:38.969616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:38.970664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:38.971792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:38.972308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:38.972743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:39.163910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:39.171557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:39.171986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f57a9cc-2f34-4b4b-8d8c-651e7060c68f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220734 Sep 13 16:27:39.172554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1393/2784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:39.180422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:39.180774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee2332ba-306c-4c98-8ccb-2dd36cae7159 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222878 Sep 13 16:27:39.181172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:39.187252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1392/2785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:39.187426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:39.187768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:39.188330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:39.189625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:39.190143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:39.190573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:39.194538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:39.195203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:39.201277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:39.201753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:39.202182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:39.202853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:39.203322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:39.203741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:39.379911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:39.388152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf7b9d92-3904-4422-a23e-279f80a2d1fc tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.211431 Sep 13 16:27:39.388719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1394/2786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:39 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:39.394335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:39.402811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:39.404296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:39.405465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8173e158-b8a0-4a3c-91f7-ae5181db23e2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215035 Sep 13 16:27:39.406008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1393/2787] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:40.197893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:40.200072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:40.204776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.204942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:40.205373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.205529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:40.205674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.206338 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.206789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.207238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.213394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.213892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.214338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.215069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.215848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.215984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.405225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:40.409530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:40.413921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14cdf9f2-3601-4a52-8be3-8af51790bfff tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220107 Sep 13 16:27:40.414500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1395/2788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:40.417950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00399b9b-8473-4eb9-939a-057514db3f9f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216918 Sep 13 16:27:40.418675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1394/2789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:40.418870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:40.419528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:40.425892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.426387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.426812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.427626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.428084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.428513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.435781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:40.436433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:40.442785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.443795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.443795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.444424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:40.444873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:40.445295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:40.625244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:40.629286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:40.633589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7beaecdd-e64a-4cdb-8ce8-119f988e901c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218102 Sep 13 16:27:40.634164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1396/2790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:40 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:40.638252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:40.639833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:40.641070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-547372ff-99a6-4c94-80fc-5b2fff290366 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.208994 Sep 13 16:27:40.641694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1395/2791] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:41.437669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:41.438304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:41.444778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:41.445392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:41.445652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.446127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.446816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.447532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.447987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.448407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.452326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.452814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.453255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.453949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.455096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.455624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.641226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:41.645826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:41.650248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05bb4aab-f289-4d9f-bf5b-000a452197dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216390 Sep 13 16:27:41.651620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1397/2792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:41.656557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:41.657161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:41.664375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.664625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4457bd92-7240-4d45-a59f-83254fa0c340 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.223510 Sep 13 16:27:41.664866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.671080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.671281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1396/2793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:41.671393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.671393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.671393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.671643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:41.671643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:41.677138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.677620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.678056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.678742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:41.679213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:41.679639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:41.861692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:41.868990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:41.869924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06348c55-a356-46a9-a588-a861ccf9f7d2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216870 Sep 13 16:27:41.870472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1398/2794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:41 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:41.877872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:41.879476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:41.880809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd18259b-5152-4730-a443-5ad904f53eee tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214317 Sep 13 16:27:41.881437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1397/2795] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:42.676748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:42.677359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:42.683743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.684223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.684654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.685335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.685781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.686234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.688125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:42.689488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:42.695821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.696299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.696984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.697665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.698114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.698565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.879356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:42.883386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:42.887619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02785e5c-e9c8-4fa9-964c-e014d277cc21 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215503 Sep 13 16:27:42.888477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1399/2796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:42.891937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78620ef9-1ad5-4c7c-9e47-ca5cae8b9318 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.207336 Sep 13 16:27:42.892649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1398/2797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:42.892880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:42.893607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:42.899330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.899813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.901984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.901984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.901984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.901984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.912826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:42.913443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:42.919459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.919940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.920379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:42.921071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:42.921521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:42.921945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:43.115807 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:43.122610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:43.124957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:43.126459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:43.127950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c1fd9b2-beb8-4945-a8cd-78b6766bb123 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.223427 Sep 13 16:27:43.128602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1399/2798] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:42 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:43.130925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61326a23-8201-432f-a645-8464a8bcf84b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.241478 Sep 13 16:27:43.131663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1400/2799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:42 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:43.911018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:43.911691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:43.918153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:43.918632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:43.918759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:43.919231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:43.919344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:43.919782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:43.920230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:43.920654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:43.925575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:43.926055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:43.926487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:43.927194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:43.927639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:43.928067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:44.110293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:44.119369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2035be7f-7953-48e3-a39a-faf6b93e78b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.204351 Sep 13 16:27:44.119942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1401/2800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:44.137629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:44.146133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-257e8805-e6ee-4fd3-b209-adeb1e15876b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.239023 Sep 13 16:27:44.146718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1400/2801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:44.153226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:44.153405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:44.153911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:44.154033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:44.160178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:44.160340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:44.160669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:44.160796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:44.161165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:44.161302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:44.161872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:44.162035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:44.162330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:44.162676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:44.162795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:44.163131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:44.357510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:44.361194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:44.366745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:44.368207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:44.369344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0372c301-2c5f-4bf4-a3cd-cedf4734c369 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.220035 Sep 13 16:27:44.369477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c4b12ea-3638-436d-b515-276a4df6e518 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219762 Sep 13 16:27:44.370085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1402/2802] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:44.375025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1401/2803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:44 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:45.144305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:45.145000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:45.151313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.151787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.152219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.152891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.153337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.153753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.169494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:45.170105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:45.176736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.177218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.177654 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.178337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.178792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.179245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.333559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:45.342008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3245a509-1d29-4138-970c-353ff9a2001f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.202539 Sep 13 16:27:45.342582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1403/2804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:45.358823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:45.367723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-de82b46a-f422-47ba-87c4-f4de167f19f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.202004 Sep 13 16:27:45.368286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1402/2805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:45 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:45.395139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:45.395758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:45.397055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:45.397670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:45.401648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.402128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.402559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.403281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.403468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.403731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.403950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.404154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.404390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.405072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:45.405527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:45.405953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:45.589905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:45.599349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:45.600945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:45.602271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77cf01ea-1ce7-4b60-aa2f-cc6e3d0ac966 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211292 Sep 13 16:27:45.602936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1404/2806] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:45.604304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:45.612671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0d22ba6-4f55-4e24-8165-c7593999b646 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.219202 Sep 13 16:27:45.613227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1403/2807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:45 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:46.366114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:46.366767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:46.373257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.373730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.374164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.374844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.375322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.375743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.391324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:46.392683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:46.399430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.399911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.400343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.401030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.401557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.402102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.575888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:46.580562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:46.584671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b30c27a7-6048-489b-a9f3-070ecde5caa4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222481 Sep 13 16:27:46.585222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1405/2808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:46.588935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ec89fbc-bff1-44bc-9e86-9af3a032778f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.201391 Sep 13 16:27:46.589490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1404/2809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:46.627668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:46.628203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:46.630078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:46.634642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:46.635289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:46.635415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.635870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.636347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.637033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.637482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.637909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.643170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.643805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.644326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.645094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:46.645620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:46.646049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:46.650062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:46.835304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:46.838948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:46.843995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:46.846002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:46.847200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4697b393-2246-4f86-8772-20710adfa819 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.223604 Sep 13 16:27:46.847767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1406/2810] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:27:46.848119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0429dcb4-0bfd-4aa9-9499-7935c574ce47 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217108 Sep 13 16:27:46.848755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1405/2811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:46 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:47.608803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:47.609504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:47.613194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:47.613936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:47.616860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.617341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.617891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.618508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.618980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.619399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.620368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.620854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.621291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.621981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.622443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.622869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.812000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:47.816649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:47.821014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47d8e1c1-bfc7-4fa9-966f-5444725ba85a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216308 Sep 13 16:27:47.821869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1407/2812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:47.825995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9eb8234d-6df3-419f-afda-0e49d00a9303 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216984 Sep 13 16:27:47.826677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1406/2813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:47.871592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:47.872156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:47.872383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:47.873003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:47.878754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.879278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.879613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.879740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.880089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.880424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.880533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.880880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.881180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:47.881319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.881629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:47.882049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:47.885251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:48.073085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:48.076211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:48.082075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:48.083552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:48.084737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18dcb37f-1e7e-4a56-b52d-42adacd635fb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216081 Sep 13 16:27:48.084877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f3a6c3d-214b-4738-8870-617607befd23 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217126 Sep 13 16:27:48.085299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1407/2814] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:48.086295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1408/2815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:47 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:48.846171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:48.846780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:48.850545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:48.851196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:48.853237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:48.853720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:48.854162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:48.854847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:48.855325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:48.855754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:48.857466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:48.857939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:48.858370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:48.859073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:48.859518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:48.859940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:49.054716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:49.057959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:49.064329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-603c0da5-f0af-4d3f-ac10-5ce5b86987c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222342 Sep 13 16:27:49.065013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1408/2816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:49.066547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ecddefd-fb9a-45ca-84a4-5b1989da551c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219789 Sep 13 16:27:49.067220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1409/2817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:49.107024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:49.107630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:49.109056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:49.109662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:49.114581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:49.115095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:49.115562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:49.116062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:49.116248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:49.116529 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:49.116702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:49.116959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:49.117133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:49.117636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:49.118077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:49.118493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:49.308207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:49.311459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:49.317649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:49.319128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:49.319697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c481d06-db65-413b-aae7-cc13c809b3d3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216508 Sep 13 16:27:49.320260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1409/2818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:49 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:49.320426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c02d71c-3bd9-4d25-a0b9-1b45cd601a44 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214895 Sep 13 16:27:49.320836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1410/2819] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:49 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:50.087567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:50.088190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:50.090511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:50.091154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:50.094588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.095162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.095609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.096314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.096769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.097203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.097394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.097876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.098311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.099025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.099477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.099902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.289966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:50.293803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:50.299227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-392e3a58-d453-4028-a8d5-ba804dc13431 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215294 Sep 13 16:27:50.299896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1410/2820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:50.302818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16925cbf-9579-462b-a4ec-ec68e134bc94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216134 Sep 13 16:27:50.303406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1411/2821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:50.344105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:50.344722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:50.345180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:50.345778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:50.350609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.351143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.351528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.351658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.352022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.352236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.352449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.352687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.353110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.353229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:50.353584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:50.354000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:50.767992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:50.772019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:50.776782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-795e2ab1-7961-436d-8b5e-fb103a5a79ef tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.436646 Sep 13 16:27:50.777905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1411/2822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:50 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:50.796532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:50.798009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:50.800074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11f3de5a-e406-4500-bc43-36fea7c13d99 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.458686 Sep 13 16:27:50.800631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1412/2823] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:51.324125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:51.325035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:51.326989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:51.327616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:51.333041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.333524 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.334202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.334709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.335405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.335551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.335694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.336817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.337272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.338190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.338709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.339367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.530154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:51.533582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:51.539115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82bf613f-f62b-4528-a89a-8a41c23be4b8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219120 Sep 13 16:27:51.539716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1412/2824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:51.549103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c5ae9c0-3d0d-4612-9769-d929c25bbdf4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219316 Sep 13 16:27:51.549103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1413/2825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:51 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:51.801158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:51.801682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:51.807603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.808084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.808521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.809210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.809659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.810078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.825052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:51.825648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:51.832515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.833000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.833433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:51.834122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:51.834549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:51.835177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:52.005617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:52.012209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:52.013841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a37e0d9f-814c-46c1-b73f-a67132ee09da tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216732 Sep 13 16:27:52.014408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1414/2826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:51 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:52.021777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:52.023293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:52.024492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80b3b458-0ca9-43e5-8314-6fbcfc5eaf9e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.203533 Sep 13 16:27:52.025045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1413/2827] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:52.562408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:52.563044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:52.567383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:52.568004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:52.570000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:52.570485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:52.571272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:52.572229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:52.572678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:52.573101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:52.574297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:52.574776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:52.575246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:52.575935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:52.576387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:52.576814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:52.764843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:52.768429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:52.773877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5075950-3475-473d-a53e-1ff7da61cbe1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215280 Sep 13 16:27:52.774449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1415/2828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:52.783587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b41ef9d-0b27-49f6-986d-6be13ea8380e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220480 Sep 13 16:27:52.784213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1414/2829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:53.037612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:53.038229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:53.044343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.044830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.045270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.045975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.046424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.046852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.050723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:53.051354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:53.054164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:53.058413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.058888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.059349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.060034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.060477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.060903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.241697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:53.245679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:53.249892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dbe90190-3ba1-4194-bfb5-c36b87cf64c4 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216091 Sep 13 16:27:53.250464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1416/2830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:53 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:53.254684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:53.256251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:53.257512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e288f911-b120-456f-b856-0aa66dc75eed tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211681 Sep 13 16:27:53.258128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1415/2831] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:53.797536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:53.798624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:53.804674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.805151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.805585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.806267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.806713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.807156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.807731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:53.808345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:53.815225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.815702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.816137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:53.816825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:53.817275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:53.817700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:54.006431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:54.009326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:54.014696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d2b66c4f-11c1-4fe9-ac99-c995beef1d13 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.220991 Sep 13 16:27:54.015276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1417/2832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:54.017969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbcb3acb-2fcd-48cf-80ac-59e90fc6a420 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214060 Sep 13 16:27:54.018528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1416/2833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:54.273142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:54.273756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:54.279867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:54.280349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:54.280786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:54.281476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:54.281924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:54.282348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:54.283544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:54.284269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:54.290194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:54.290676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:54.291145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:54.291830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:54.292281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:54.292704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:54.477147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:54.481072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:54.486802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-270631d0-98e6-4c7b-93cf-0248a0c7d75e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217462 Sep 13 16:27:54.487560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1418/2834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:54 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:54.490960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:54.492390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:54.493537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f1d0822-bff2-4005-bd22-84dcc640f735 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214401 Sep 13 16:27:54.494080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1417/2835] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:55.038693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:55.039339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:55.044297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:55.044297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:55.046702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.047351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.051663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.052148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.052579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.053275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.053714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.054134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.057750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.062811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.062811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.062811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.255925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:55.265556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d888d37f-5a6e-4503-a868-7a4fb9ba747e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.227773 Sep 13 16:27:55.266143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1418/2836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:55.274150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:55.284654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a6f99e7-7694-4f28-8c18-ef7d07b659c4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.250323 Sep 13 16:27:55.285229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1419/2837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:55.510110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:55.511088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:55.517837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.518327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.518763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.519511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.520077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.520334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:55.520497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.521145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:55.530224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.530710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.531179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.531879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:55.532336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:55.533484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:55.726642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:55.730387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:55.735867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d77e4a5a-e314-44be-b40f-e25f9e95b281 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.229739 Sep 13 16:27:55.736647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1419/2838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:55 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:55.739078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:55.740572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:55.741736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02df482e-98fa-42fd-ad94-33fdef9b243e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.226847 Sep 13 16:27:55.742286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1420/2839] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:56.289766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:56.290367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:56.296719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.297192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.297622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.298401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.299092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.299516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.308583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:56.309221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:56.315751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.316171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.316607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.317297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.317749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.318183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.493948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:56.500673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:56.502919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebda72b8-03b1-4508-a94b-96c9a10f0136 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216707 Sep 13 16:27:56.503498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1420/2840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:56.509675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b79221e2-8b4d-4826-9fa4-f561e3f033b7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.204925 Sep 13 16:27:56.510226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1421/2841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:56.759262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:56.759863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:56.765870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.766345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.766815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.767888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:56.768139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.768514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:56.768644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.768991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.774353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.774828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.775303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.775995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:56.776448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:56.776875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:56.959306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:56.962206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:56.969368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-44c0fd01-6e91-42f2-a665-2492cdd4094a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213824 Sep 13 16:27:56.969982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1421/2842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:56 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:56.970538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:56.979557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:56.981019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:56.982181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da560266-bfdd-4374-8771-481d3fdccd34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218781 Sep 13 16:27:56.982727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1422/2843] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:56 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:57.526845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:57.527493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:57.532967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:57.534199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:57.534705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:57.535214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:57.535659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:57.536346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:57.536798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:57.537225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:57.540830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:57.541306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:57.541738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:57.542417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:57.542860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:57.543306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:57.726306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:57.730123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:57.734661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dec791c9-774a-4103-96b1-18d2e8d0c073 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.205501 Sep 13 16:27:57.735262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1423/2844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:57.738601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3fcc98ea-28b4-4e51-a994-4260c4ef449c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215652 Sep 13 16:27:57.739202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1422/2845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:57.992130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:57.992743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:57.998680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:57.999188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:57.999626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.000308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.000759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.001183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.008058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:58.008800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:58.014658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.015182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.015623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.016317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.016776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.017198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.191516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:58.194116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:27:58.201779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-425dddd5-ca41-42b4-96ae-c18101491a5b tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213389 Sep 13 16:27:58.202437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1424/2846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:57 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:58.203447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:58.215888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:58.217575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:58.219730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c560640-125a-4c46-8e89-8f207650dbb0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215078 Sep 13 16:27:58.220328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1423/2847] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:58.757673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:58.758410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:58.761811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:58.762423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:58.764856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.765346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.765785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.766472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.766944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.767378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.768460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.769148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.769586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.770273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:58.770726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:58.771182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:58.962096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:58.969050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:58.970367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca298700-2d9b-4e7c-8116-e3fe00796ed8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216593 Sep 13 16:27:58.971459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1425/2848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:58.978412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ab59ee6-e2e7-4f47-9dcc-cb633e975d46 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.220382 Sep 13 16:27:58.979002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1424/2849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:58 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:27:59.226548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:59.227187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:59.233043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:59.233516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:59.233952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:59.234656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:59.235143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:59.235564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:59.245484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:59.246091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:27:59.252811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:59.253292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:59.253723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:59.254412 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:27:59.255509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:27:59.255945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:27:59.428998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:59.437134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25887487-45ad-452f-8171-da69fa8dbcb2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214685 Sep 13 16:27:59.437884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1426/2850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:59 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:27:59.445405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:59.454134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:59.456788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:27:59.457937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-313c683d-fe08-4ee3-aba0-4aba461488cd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217731 Sep 13 16:27:59.458486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1425/2851] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:27:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:27:59.994061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:27:59.994672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:00.000801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.001320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.001739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.003287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.003746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.004197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.004307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:00.004803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:00.011141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.011619 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.012049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.012757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.013204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.013621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.199247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:00.203386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:00.207827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-537ac622-dc5e-4fa7-ba7a-3d34aaa9ed42 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217584 Sep 13 16:28:00.208402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1427/2852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:00.211849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51c3c4dd-9999-42c4-990b-bfda0174fe90 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212763 Sep 13 16:28:00.212408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1426/2853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:27:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:00.461035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:00.461679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:00.468122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.468602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.469041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.469734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.470184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.470610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.482366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:00.483000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:00.489594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.490446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.490591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.491233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:00.491687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:00.492110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:00.655789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:00.664861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c17d817c-62ba-4d62-8f71-7d5c29cbba02 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.207725 Sep 13 16:28:00.665462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1428/2854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:00 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:00.678806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:00.687433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:00.688870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:00.690139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-feb3a0d0-9e62-4bb1-9bf7-7387de60a326 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211439 Sep 13 16:28:00.690690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1427/2855] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:01.232496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:01.233108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:01.235697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:01.236306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:01.239224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.239711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.240147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.240836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.241307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.241713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.243179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.243802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.244239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.244917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.245364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.245790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.433843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:01.440971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:01.443319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da38fecb-fbd1-49c1-9d2f-ea54f2634bd8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215047 Sep 13 16:28:01.443966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1429/2856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:01.450104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57ee7aef-bd06-4d83-96e6-7f558476bf37 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218513 Sep 13 16:28:01.450662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1428/2857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:01.688602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:01.689209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:01.696679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.697406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.697835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.698511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.698983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.699408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.715944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:01.716547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:01.723073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.723550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.723982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.724661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:01.725105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:01.725551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:01.901016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:01.904285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:01.909437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93de6ddf-a863-4513-b765-c6eb8fec2980 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.224661 Sep 13 16:28:01.910211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1430/2858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:01 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:01.913409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:01.914959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:01.916207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88fffffc-c984-4f2a-a070-0057c6abbe14 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.204235 Sep 13 16:28:01.916829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1429/2859] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:02.466490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:02.468584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:02.473699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.474188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.474384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:02.474812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.475087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:02.475335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.475818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.476241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.481721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.482205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.482645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.483453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.483895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.484325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.666888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:02.670134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:02.676054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3964a43-c7d7-4aac-b1d1-0d039d3ad60f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213320 Sep 13 16:28:02.676630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1431/2860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:02.678813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9d807ff-ecb7-4aea-92b1-6dfd417e1d72 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.209085 Sep 13 16:28:02.679410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1430/2861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:02.932207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:02.932748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:02.939167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.939642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.940302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.941087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.941540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.941785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:02.941961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.942392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:02.948511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.948985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.949413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:02.950088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:02.950531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:02.950975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:03.133385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:03.137447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:03.141899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:03.144033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:03.145124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ab00edd-3da5-4053-97b2-27b1ed24ab7f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.207228 Sep 13 16:28:03.145680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1431/2862] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:02 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:03.146327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd3c16f0-e662-42a6-87f2-0eb3d02700a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218040 Sep 13 16:28:03.146882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1432/2863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:02 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:03.699200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:03.699819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:03.701283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:03.701898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:03.707219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:03.707715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:03.708157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:03.708832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:03.708974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:03.709297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:03.709411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:03.709731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:03.709858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:03.710459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:03.710931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:03.711358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:03.900827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:03.904585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:03.909411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fd08d71-dfd2-4c7f-a2d3-57627c243437 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214296 Sep 13 16:28:03.909997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1432/2864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:03.913408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-180a83af-5ab6-4fdb-8e42-e324ee38480b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216099 Sep 13 16:28:03.913967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1433/2865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:04.172963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:04.173953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:04.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:04.176183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:04.183955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.184764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.185471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.186113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.186587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.186885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.187369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.187627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.188061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.188735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.189478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.190943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.381216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:04.385168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:04.389358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ecf24fe-367f-4761-a288-7fdd0cd6f1e3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222781 Sep 13 16:28:04.389924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1433/2866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:04 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:04.394589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:04.396071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:04.397222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24b07dda-9857-4b49-bb6a-a5cda25182ff tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.229480 Sep 13 16:28:04.397764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1434/2867] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:04.932860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:04.933459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:04.936826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:04.937424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:04.940681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.941172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.941606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.942293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.942742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.943189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.943828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.944305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.944733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:04.945408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:04.945854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:04.946272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:05.133952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:05.140818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:05.142117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36fcc370-c049-42df-ac39-01e52f326749 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213164 Sep 13 16:28:05.142729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1434/2868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:05.149449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-920158b6-be40-46a3-be28-3c198b1e6921 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216255 Sep 13 16:28:05.149997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1435/2869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:04 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:05.413217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:05.413824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:05.419859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:05.420338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:05.420768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:05.421444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:05.421888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:05.422307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:05.423658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:05.424923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:05.431245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:05.431727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:05.432162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:05.432848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:05.433302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:05.433723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:05.614739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:05.623565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a11fa4a-9538-4fbc-a26e-c4d1ca6734a8 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.213906 Sep 13 16:28:05.623994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1435/2870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:05 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:05.627718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:05.641520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:05.643127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:05.644500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-881f5224-8b58-46c6-b688-f559e227072f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.225319 Sep 13 16:28:05.645047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1436/2871] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:06.165493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:06.166104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:06.172528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.172946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:06.173351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.173474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.173592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:06.174105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.174558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.175012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.179936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.180424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.180863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.181587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.182044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.182472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.370340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:06.373228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:06.379507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c2f067f-cac3-4778-bf98-ab81446fa170 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217794 Sep 13 16:28:06.380089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1436/2872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:06.381841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6637108-077d-4b92-a4b7-5c5a5a9c81a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212806 Sep 13 16:28:06.382392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1437/2873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:06.646645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:06.647195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:06.653160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.653645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.654087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.654771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.655247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.655674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.670023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:06.671621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:06.679041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.679528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.679964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.680661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:06.681113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:06.681698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:06.860476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:06.865362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:06.869435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb58a035-e784-410d-bdba-455fd9946169 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.226920 Sep 13 16:28:06.870011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1437/2874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:06 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:06.873831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:06.875311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:06.876451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c6de8dc5-c302-4c53-932f-bf41abb0a050 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210710 Sep 13 16:28:06.876996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1438/2875] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:07.403464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:07.404079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:07.404927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:07.405536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:07.411123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.411622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.411838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.412058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.412332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.412746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.412885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.413193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.413424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.413615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.413867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.414292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.428557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:07.834503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:07.841335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:07.842825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c52db87f-1875-48fc-8478-894b95b4cbe4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.441623 Sep 13 16:28:07.843425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1439/2876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:07.850392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bef5f2b-712e-42f1-a170-054f63e46a1f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.451135 Sep 13 16:28:07.850962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1438/2877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:07.892390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:07.893225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:07.899196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.899678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.900105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.900789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.901232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.901651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.902638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:07.903271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:07.909922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.910404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.910839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:07.911545 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:07.911992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:07.912409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:08.097951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:08.101300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:08.106139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26660fab-a6da-467b-ad84-8882c8b66e4e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217456 Sep 13 16:28:08.106701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1440/2878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:07 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:08.110051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:08.111528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:08.112788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf4548cb-2c68-42af-98dd-21ab2cb4269f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213751 Sep 13 16:28:08.113346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1439/2879] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:08.867786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:08.868386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:08.873713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:08.874353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:08.874772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:08.875420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:08.875856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:08.876544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:08.876991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:08.878099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:08.881480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:08.881952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:08.882386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:08.883103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:08.883551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:08.883970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:08.893419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:09.067846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:09.071751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:09.076512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc7c9919-d9d8-4323-862d-c739c9e270af tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.212568 Sep 13 16:28:09.077090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1441/2880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:09.080211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3462892a-51c8-468c-a2cf-c88f641bf715 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.210196 Sep 13 16:28:09.080765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1440/2881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:09.129055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:09.129658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:09.136222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:09.136697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:09.137130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:09.137589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:09.137812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:09.138208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:09.138334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:09.138662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:09.144053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:09.144534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:09.144977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:09.145664 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:09.146117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:09.146546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:09.331905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:09.334743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:09.340158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9560768-ac0e-44fb-9f5c-4b8094b5a4a0 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214828 Sep 13 16:28:09.340758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1442/2882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:09 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:09.343508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:09.344951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:09.346115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a7108fcb-8470-4207-96da-4f4c3c01bb32 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.212484 Sep 13 16:28:09.346669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1441/2883] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:09 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:10.102163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:10.102736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:10.103232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:10.103845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:10.109240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.109672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.109801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.110160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.110278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.110580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.110839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.111276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.111384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.111721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.111853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.112143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.303929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:10.307976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:10.312052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-344f6bde-0fcb-4c85-b6ff-dcb96334f1cc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212485 Sep 13 16:28:10.312611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1442/2884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:10.316260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44144d66-39a9-4817-ac34-3361c4e399a4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218401 Sep 13 16:28:10.316978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1443/2885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:10 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:10.363822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:10.364671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:10.372150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.372635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.372775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:10.373065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.373377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:10.373747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.374191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.374607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.379189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.379704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.380142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.380837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:10.381291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:10.381718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:10.565550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:10.568451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:10.574402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1add4d9e-7732-4dd4-bbc1-d027e0e2c7cd tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214898 Sep 13 16:28:10.575078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1443/2886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:10 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:10.577376 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:10.578817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:10.579995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7152d24b-1c03-4e49-8b27-4a291adc2f11 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211603 Sep 13 16:28:10.580546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1444/2887] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:10 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:11.336138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:11.336748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:11.339889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:11.340504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:11.343214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.343703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.344141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.344855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.345305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.345729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.346866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.347381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.347817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.349173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.349714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.349972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.545074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:11.548185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:11.553952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-15cf05eb-5713-4722-b52a-15abfc7e09eb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.222353 Sep 13 16:28:11.554613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1444/2888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:11.557659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3fdd12a-9b2b-4de2-8fc1-c189ee897ca6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221622 Sep 13 16:28:11.558216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1445/2889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:11.597242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:11.597852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:11.604327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.604815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.605252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.605485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:11.605941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.606124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:11.606394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.606820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.611918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.612386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.612814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.613622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:11.614672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:11.615974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:11.803111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:11.806551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:11.811350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc9eeaf3-33c4-4373-bef8-29accd4ea2a1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.217741 Sep 13 16:28:11.811931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1445/2890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:11 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:11.815240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:11.816678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:11.817851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d49e380a-73ed-45bf-8921-d7e346c6557b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216394 Sep 13 16:28:11.818394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1446/2891] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:11 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:12.577137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:12.577760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:12.581224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:12.581829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:12.584303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.584793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.585236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.585931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.586386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.586814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.587854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.588335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.588764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.589434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.589875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.590293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.779725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:12.782869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:12.788096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76be6e17-a41e-4cd0-940a-74b93ae293ef tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214789 Sep 13 16:28:12.788703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1446/2892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:12.791301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d028b21-72fc-4e00-b0f5-9b4c85ca2081 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214169 Sep 13 16:28:12.791943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1447/2893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:12.835826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:12.836435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:12.842478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.842990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.843424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.844103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.844546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.844960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.845330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:12.845942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:12.852157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.852637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.853072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:12.853755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:12.854385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:12.855126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:13.049418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:13.054409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:13.058737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef381fcf-1cd6-4af8-b0db-69eacbe1876a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.227533 Sep 13 16:28:13.059510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1447/2894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:12 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:13.063210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:13.064810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:13.065788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4176804-386b-41e9-9c94-5ef048db0b5b tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.225191 Sep 13 16:28:13.066320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1448/2895] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:12 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:13.811722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:13.812352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:13.814478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:13.815124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:13.820176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:13.820658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:13.821089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:13.821775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:13.821988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:13.822220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:13.822729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:13.822892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:13.823224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:13.823924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:13.824379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:13.824806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:14.027024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:14.030143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:14.035209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c121102-2602-4de9-9234-d43b28f8e159 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.224601 Sep 13 16:28:14.035798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1449/2896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:14.038404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6f155ad-c49b-4484-9031-ae32f430f6d5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.230649 Sep 13 16:28:14.038983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1448/2897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:14.081571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:14.082189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:14.088379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:14.088863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:14.089300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:14.089989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:14.090440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:14.090867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:14.092109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:14.092938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:14.102956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:14.103641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:14.104138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:14.104841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:14.105288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:14.106210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:14.295923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:14.298873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:14.304938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-571ac9b6-10db-4f9b-89af-fbad5269b51c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.227260 Sep 13 16:28:14.305517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1450/2898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:14 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:14.308867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:14.310353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:14.311541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30d5fef2-bf45-46b5-a2ac-7ea16cbfd0e0 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.223925 Sep 13 16:28:14.312129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1449/2899] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:14 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:15.059068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:15.059763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:15.061289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:15.061907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:15.065861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.066336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.066762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.068060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.068338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.068514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.068821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.068950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.069263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.069952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.070405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.070858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.264595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:15.268461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:15.274413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee8b3487-f679-4372-ae26-fd68370d0c68 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219362 Sep 13 16:28:15.275007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1451/2900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:15.277483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76276832-15f8-47a3-9f3d-482eafeff6e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219729 Sep 13 16:28:15.277885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1450/2901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:15.328909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:15.329541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:15.336245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.336729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.337164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.337854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.337987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:15.338306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.338513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:15.338725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.344379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.344857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.345294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.345984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:15.346436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:15.346864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:15.532683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:15.536810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:15.540961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1eb9a956-1ab7-45f4-a396-c917ec8be06a tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215796 Sep 13 16:28:15.541535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1452/2902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:15 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:15.545398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:15.546825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:15.547986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9afef62d-d408-46dc-b5ce-8789d569bfaa tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213872 Sep 13 16:28:15.548528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1451/2903] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:15 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:16.298573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:16.299292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:16.300198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:16.300815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:16.306021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.306527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.306944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.307228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.307627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.307766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.308072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.308205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.308489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.308806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.309258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.309681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.503289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:16.507249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:16.511591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3155bd29-d5c0-41be-904d-d15358b8f2ad tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215100 Sep 13 16:28:16.512162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1452/2904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:16.515571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bc91d7e-ed34-40e4-85eb-f19d3ca34d66 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221711 Sep 13 16:28:16.516137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1453/2905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:16.564081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:16.564690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:16.570740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.571256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.571693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.572637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.573085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.573505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.573907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:16.574523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:16.580434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.580933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.581351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.582037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:16.582490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:16.583459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:16.769240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:16.772683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:16.778868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:16.780326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:16.780754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-203b2209-9a38-4333-9020-b05b2fd809e6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220458 Sep 13 16:28:16.781324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1453/2906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:16 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:16.781465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b554631-582e-4cec-90c5-b74b347b90b5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.211928 Sep 13 16:28:16.781993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1454/2907] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:16 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:17.534595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:17.535263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:17.539910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:17.540515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:17.542318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.542825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:17.543006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.543596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.544011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.544471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.544894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.548205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.548698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.549131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.549818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.550266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.550687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.734872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:17.738408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:17.743824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1a9afb4-2dae-4600-b226-68360c4d36f1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.213005 Sep 13 16:28:17.744398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1454/2908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:17 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:17.747366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38487983-4ed0-41f1-b7a8-7231233150bf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.211904 Sep 13 16:28:17.747926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1455/2909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:17.804186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:17.804903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:17.805812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:17.806432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:17.811063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.811542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.811971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.812251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.812682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.812817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.813133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.813293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.813558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.813829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:17.814283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:17.814709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:17.817547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:18.007157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:18.009948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:18.015518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bff5e0d3-e5d7-473f-8ff4-1bc2f703ea56 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215184 Sep 13 16:28:18.016205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1455/2910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:17 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:18.019070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:18.021270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:18.022528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-380cf216-83c2-4286-aed3-ed0c61d127eb tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.220400 Sep 13 16:28:18.023184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1456/2911] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:17 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:18.767541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:18.768159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:18.771104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:18.771716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:18.775206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:18.775693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:18.776133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:18.776825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:18.777272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:18.777696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:18.777815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:18.778288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:18.778715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:18.779423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:18.779866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:18.780286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:18.972724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:18.976600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:18.981614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24de7105-de89-4b9b-ace4-1de2f573b60e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217905 Sep 13 16:28:18.982188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1456/2912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:18.985117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-673e6851-9c80-409e-b960-1b5891e24753 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218359 Sep 13 16:28:18.985681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1457/2913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:19.039685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:19.040597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:19.047707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:19.048293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:19.048801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:19.049568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:19.050139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:19.050742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:19.050881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:19.051452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:19.058414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:19.059243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:19.059879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:19.060741 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:19.061352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:19.061947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:19.065352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:19.248952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:19.252643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:19.258005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca2edf06-5f11-4792-adc1-3feb6c41b635 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.222582 Sep 13 16:28:19.258613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1457/2914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:19 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:19.262000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:19.263545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:19.264768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1223915d-027b-4a07-9235-a3ba958d66df tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.221520 Sep 13 16:28:19.265383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1458/2915] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:19 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:20.004418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:20.005793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:20.012204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.013010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.013458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.014141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.014592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.015050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.067611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:20.068421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:20.075122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.075611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.076057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.076753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.077212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.077642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.185700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:20.195966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ba47ea5-05c3-496b-868e-8e693ca8b11f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.195339 Sep 13 16:28:20.196546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1458/2916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:20.229833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:20.238096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ded5b34e-3abc-4593-bca0-2304fba3506b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.177054 Sep 13 16:28:20.238656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1459/2917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:20 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:20.281525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:20.282098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:20.288663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.289144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.289582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.290024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:20.290268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.290625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:20.290751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.291153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.296359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.296837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.297267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.297941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:20.298383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:20.298802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:20.488672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:20.492305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:20.498308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-afd3fdad-02cb-44f6-8723-b4541dae3a5e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220666 Sep 13 16:28:20.498880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1459/2918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:20 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:20.500935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:20.502375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:20.503548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6eaa9883-939d-4fca-aee5-f5d4751bc7cf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218097 Sep 13 16:28:20.504251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1460/2919] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:20 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:21.219991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:21.220593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:21.227895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.228438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.228893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.229606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.230067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.230501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.261825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:21.262444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:21.268908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.269383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.269817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.271201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.271922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.272551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.415990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:21.424106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cba32750-9fd0-479e-8f12-b947dd44d65d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.208254 Sep 13 16:28:21.424866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1460/2920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:21.442667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:21.452100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a72c5d8c-bf85-48d9-bd14-4d604114b882 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.194183 Sep 13 16:28:21.463113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1461/2921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:21.522288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:21.523120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:21.527782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:21.528398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:21.529282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.529846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.530358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.531086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.531541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.531970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.534649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.535402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.537354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.537354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:21.537354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:21.537655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:21.776337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:21.780514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:21.785208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:21.787221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:21.788427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e0a9154-fcf5-49b1-a088-564d95b2e98d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.264428 Sep 13 16:28:21.788983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1462/2922] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:21 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:21.791430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4808fca6-2b6d-4336-859d-66900d65deb9 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.273668 Sep 13 16:28:21.802921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1461/2923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:21 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:22.448646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:22.449190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:22.455541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.456021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.456498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.457170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.458229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.458669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.478123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:22.478730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:22.485008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.485484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.485916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.486596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.487070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.487493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.642268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:22.651181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4146e81-d468-49d6-8e49-8466d71da724 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.206693 Sep 13 16:28:22.651749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1463/2924] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:22 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:22.665289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:22.673509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a36552d-6d9d-4884-a240-76790bd3226c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.199904 Sep 13 16:28:22.674067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1462/2925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:22.814453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:22.814667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:22.815005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:22.815172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:22.821652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.821824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.822128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.822241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.822814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.822972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.823534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.823649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:22.823962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.824099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:22.824385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:22.824547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:23.014254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:23.017737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:23.023323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:23.024756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:23.025902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7257d00f-b7df-4446-9710-d1d572c6a17d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.215397 Sep 13 16:28:23.026270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d08118ca-e57f-4ab6-8ce5-914b0c0d05fe tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215609 Sep 13 16:28:23.026784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1464/2926] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:22 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:23.026948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1463/2927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:22 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:23.673250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:23.673862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:23.680932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:23.681411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:23.681845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:23.682526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:23.683006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:23.683432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:23.697071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:23.698102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:23.700393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:23.705516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:23.705992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:23.706424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:23.707134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:23.707673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:23.708397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:24.103433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:24.107418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:24.111727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2705e77e-5da5-4f70-8846-c171eac84e24 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.442211 Sep 13 16:28:24.112294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1465/2928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:24.116559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a927d2a-7d6c-423c-bddf-4578a99d5292 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.423234 Sep 13 16:28:24.116885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:24.131417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1464/2929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:24.131642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:24.131743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:24.131743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:24.131923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:24.131923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:24.131923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:24.131923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:24.132243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:24.132243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:24.132398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:24.132398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:24.132398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:24.132398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:24.132724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:24.132724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:24.316688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:24.320609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:24.326186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:24.327670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:24.328834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-daea97ae-4f98-426b-9d1b-fcdf0638c114 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210692 Sep 13 16:28:24.329049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b2cbc029-e54c-4fa6-93d2-73d3390286ff tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.215671 Sep 13 16:28:24.329396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1465/2930] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:24 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:24.329621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1466/2931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:24 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:25.135300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:25.135911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:25.140365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:25.140973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:25.142472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.142985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.143429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.144115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.144567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.145004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.147917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.148393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.148827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.149510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.149955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.150372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.340359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:25.346851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:25.349767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c26fd94-41e9-4b85-8f2e-1a6592ae2951 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.218001 Sep 13 16:28:25.363116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1466/2932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:25.363116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:25.363116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:25.363497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57439f62-0f3a-4bc2-8ffc-9c48833431ee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.218958 Sep 13 16:28:25.363497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1467/2933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:25 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:25.363497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:25.363497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:25.364387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.364387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.364387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.364387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.364724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.365286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.367922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.367922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.368284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.370346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:25.370346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:25.370346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:25.549650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:25.558407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8af27afd-7444-43d2-80c0-3faac4d60524 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.207294 Sep 13 16:28:25.559007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1467/2934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:25 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:25.561367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:25.570789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:25.572287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:25.573752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a56ddd17-f7b1-4655-8d71-351af78289a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216718 Sep 13 16:28:25.574253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1468/2935] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:25 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:26.375840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:26.376564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:26.380379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:26.380997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:26.383700 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.384215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.384651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.385343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.385794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.386249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.387049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.387531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.387972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.388660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.389115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.389545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.578882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:26.584037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:26.587735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-405ad01e-8711-453c-9156-58a74dfdce73 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.215965 Sep 13 16:28:26.588501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1468/2936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:26.592230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b793729-31f2-42ed-8888-c3d11ee18b9d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216008 Sep 13 16:28:26.593091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1469/2937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:26.594325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:26.594972 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:26.601134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.601613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.602048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.602739 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.603219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.603769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.608971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:26.609648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:26.615549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.616022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.616457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.617138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:26.617582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:26.618001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:26.796896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:26.802047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:26.806422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a1572b4-1fd3-4e94-8a73-0982acdfa3b2 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.216839 Sep 13 16:28:26.807055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1469/2938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:26 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:26.815723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:26.817730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:26.818889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48edaea0-e0fb-4e92-90b4-b7d39b52ee13 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.213695 Sep 13 16:28:26.819668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1470/2939] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:26 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:27.611091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:27.611644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:27.617229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:27.617844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:27.618167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.618647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.619110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.619798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.620242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.620662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.624094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.624570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.625009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.625696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.626145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.626569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.812984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:27.817206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:27.821264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6806bb7-3b6a-4e69-9d8e-15db64fd79c8 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.214080 Sep 13 16:28:27.821837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1470/2940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:27.827275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4535fbde-47d8-40bf-bb9b-f08e814bdc3a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214079 Sep 13 16:28:27.830011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:27.830761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:27.838152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.838747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.839245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1471/2941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:27.839661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.840459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.841030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.841554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.843940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:27.844648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:27.851219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.851710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.852151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:27.852905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:27.853297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:27.853725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:28.035575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:28.037910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:28.043065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:28.047061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a398f6a-5663-4a69-b024-9e61697b3f6f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220757 Sep 13 16:28:28.047645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1471/2942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:27 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:28.052311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:28.053754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:28.054893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36e6d092-7c18-4af8-a536-93352aac559a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.214661 Sep 13 16:28:28.055455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1472/2943] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:27 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:28.848811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:28.849414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:28.855864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:28.856345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:28.856783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:28.857470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:28.857738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:28.858183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:28.858326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:28.859120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:28.865881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:28.866366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:28.866830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:28.867553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:28.868030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:28.868455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:29.072075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:29.079264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:29.081391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea0b9a03-a7d1-4b04-9db0-4e38c3eff289 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.236591 Sep 13 16:28:29.081978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1472/2944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:28 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:29.088412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a34e5615-fe93-4ab1-b0f2-68c78e05a4f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.235439 Sep 13 16:28:29.088575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:29.089158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1473/2945] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:29.089300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:29.097516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:29.098012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:29.099590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:29.100182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:29.100637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:29.101060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:29.108994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:29.109754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:29.116470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:29.116947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:29.117720 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:29.118223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:29.118666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:29.119110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:29.310188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:29.314460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:29.316655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:29.319372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51b65331-5002-4014-9f78-ab3b170b18c1 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.235295 Sep 13 16:28:29.319952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1473/2946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:29 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:29.326148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:29.327527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:29.328699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2fcde42-f8cd-404d-9537-28864111fe6c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.236670 Sep 13 16:28:29.329516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1474/2947] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:29 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:30.105298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:30.105988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:30.112127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:30.112573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.112743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:30.112904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.113329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.114042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.114496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.114930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.119229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.119713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.120146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.120837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.121287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.121717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.305741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:30.312352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:30.314179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-861a8703-2672-4a53-b7f2-9222e29bab9d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.212584 Sep 13 16:28:30.314704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1474/2948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:30.321885 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28e12e58-3342-4b31-b0a5-854f21b3f06d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.214165 Sep 13 16:28:30.322433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1475/2949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:30.341235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:30.341847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:30.347750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.348276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.348997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.349693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.350150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.350582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.353595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:30.354200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:30.360010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.360489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.360925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.367324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:30.367936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:30.368492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:30.543513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:30.552305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9600d62f-8f88-404d-8fcb-09bdea00393e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.214749 Sep 13 16:28:30.552882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1475/2950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:30 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:30.554837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:30.564397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:30.565791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:30.567714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a46ff6d9-9230-483a-bbfc-1883681d3fdf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.217185 Sep 13 16:28:30.568335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1476/2951] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:30 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:31.338027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:31.338637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:31.345059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.345359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:31.345804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.345972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:31.346101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.346701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.347180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.347606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.353055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.353534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.353969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.354658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.355130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.355576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.543079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:31.547066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:31.551452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0dd332d3-ceaa-42f8-b99e-e4e87706f4c3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217139 Sep 13 16:28:31.552131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1476/2952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:31.555229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de7bebdc-f835-4880-9367-ab3c3b73982a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.213663 Sep 13 16:28:31.556369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1477/2953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:31 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:31.576608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:31.577201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:31.583710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.584190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.584631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.585325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.585779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.586209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.592354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:31.592959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:31.599850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.600332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.600768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.601457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:31.601906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:31.602331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:31.783754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:31.788040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:31.792932 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-caa7f98f-d37f-41db-861d-dd71f2391bc6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.220361 Sep 13 16:28:31.793696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1477/2954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:31 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:31.796631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:31.798062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:31.799231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c15081d-8f15-4a16-abcc-05707116309e tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.210608 Sep 13 16:28:31.799778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1478/2955] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:31 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:32.576266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:32.576882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:32.579533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:32.580159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:32.583813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.584296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.584730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.585417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.585860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.586279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.586771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.587297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.587735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.588492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.588939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.589359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.779423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:32.782735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:32.788385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db3f019d-e2b5-459f-bbaf-ac2b39c8b727 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.217446 Sep 13 16:28:32.788984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1478/2956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:32.791740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec5ba3ea-aef6-405e-880c-c766d01feefc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.215998 Sep 13 16:28:32.792310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1479/2957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:32.815267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:32.815820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:32.822187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.822662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.823381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.824061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.824502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.824976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.825094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:32.825682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:32.831772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.832230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.833211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:32.833929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:32.834374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:32.834794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:33.027013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:33.030644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:33.036319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:33.037884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:33.039068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a756fbda-c571-493a-89fc-18d3710a2edc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.218027 Sep 13 16:28:33.041340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76349369-a1f5-4e4f-9201-0cc1441e974e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.228084 Sep 13 16:28:33.041531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1480/2958] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:32 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:33.041640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1479/2959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:32 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:33.810943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:33.811532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:33.813905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:33.815022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:33.818224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:33.818703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:33.819174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:33.819868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:33.820311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:33.820729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:33.820840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:33.821288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:33.821722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:33.822407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:33.823151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:33.823580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:34.014095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:34.017449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:34.023210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f083a3a-0ba0-402c-a28d-08f11eeb0ba6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.216067 Sep 13 16:28:34.023786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1481/2960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:34.026350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7eb66422-9979-46a3-b28a-088381dab50a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.216169 Sep 13 16:28:34.026921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1480/2961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:34.062970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:34.063511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:34.064241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:34.065079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:34.070456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:34.071028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:34.071455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:34.071584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:34.071931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:34.072189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:34.072367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:34.072644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:34.073305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:34.073418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:34.073753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:34.074174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:34.268619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:34.272470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:34.277519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b656717-af00-4eff-94e4-0ca795a83ff3 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218537 Sep 13 16:28:34.278092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1482/2962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:34 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:34.281155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:34.282647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:34.283913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01ff9fbd-ec6c-4fff-afa0-d501b1cab853 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.223644 Sep 13 16:28:34.284472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1481/2963] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:34 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:35.045660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:35.046389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:35.049724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:35.050336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:35.053956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.054437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.054867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.055581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.056029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.056482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.057348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.057838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.058282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.058992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.059446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.059870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.251378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:35.256390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:35.260968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40dacd11-8e4a-4b2d-ab4f-1697fe7f46ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.219181 Sep 13 16:28:35.266759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1483/2964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:35 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:35.266955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c9631ac-173c-42d9-a02f-6e88dfc53df3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.219269 Sep 13 16:28:35.266955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1482/2965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:35.305665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:35.305665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:35.309063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.309617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.309763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:35.310180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.310291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:35.311041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.311566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.312059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.316213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.316694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.317976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.318670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.319147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.319573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.507312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:35.510197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:35.515823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a79d32b3-87dc-4f41-89f3-142b7cb8d95f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.218228 Sep 13 16:28:35.516397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1484/2966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:35 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:35.519132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:35.520787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:35.520930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:35.521342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:35.521948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3fb6db51-3156-4250-9557-4b1f3ecd9419 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.216383 Sep 13 16:28:35.522806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1483/2967] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:35 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:35.527044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.527525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.527955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.528634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:35.529080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:35.529498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:35.554677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:28:35.613499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [f8313779-e08e-4f3c-a61a-fb3f2c0e036a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:28:36.284211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:36.284816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:36.291350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.291832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.292264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.292938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.293385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.293806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.424968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.433880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53f89a55-2c36-489b-81d0-9ac0b3bce07a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153585 Sep 13 16:28:36.434451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1484/2968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:36.439327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:36.439933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:36.445683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.446197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.446633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.447347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.448180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.448608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.574204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.582181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80f14a6d-c374-47c4-aada-0278c2d4a560 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146257 Sep 13 16:28:36.583456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1485/2969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:36.587914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:36.588521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:36.593965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.594433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.594861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.595554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.595996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.596411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.621638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [f8313779-e08e-4f3c-a61a-fb3f2c0e036a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 56592. Sep 13 16:28:36.641609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4dee8f56-9e4e-4da8-8999-d53fcbf97447 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 204 len: 0 microversion: 2.1 time: 1.123625 Sep 13 16:28:36.646157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1485/2970] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:28:35 2022] DELETE /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:28:36.648087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:36.648794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:36.655076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.655561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.655996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.656697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.657145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.657567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.773069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.781531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-149ed89d-214c-43ff-bede-1cebb36dca64 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.197062 Sep 13 16:28:36.782182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1486/2971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:36 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:36.787822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:36.788425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:36.794280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.794757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.795223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.795902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:36.796348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:36.796765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:36.817318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.826172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.827665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.828829 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8826687-659b-401b-a4e4-b325f423d82c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.185350 Sep 13 16:28:36.829571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1486/2972] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:36 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:36.925417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:36.933598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48ceeb3d-6898-4239-9075-cca2ffb0c8f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1718 microversion: 2.1 time: 0.150494 Sep 13 16:28:36.934163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1487/2973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:37.458071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:37.458789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:37.465208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.465692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.466130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.466822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.467299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.467725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.607219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:37.607904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:37.614570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.615090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.615671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.616380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.617004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.617435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.634680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:37.732392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:37.740833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e5371c4-3275-472c-ba13-305b1d3fb370 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.287145 Sep 13 16:28:37.741406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1487/2974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:37.805687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:37.807335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:37.812710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.813194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.813647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.814313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.814754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.815207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.928952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:37.937283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25c7d029-f879-4fc9-a0b1-488ec05e003e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.333864 Sep 13 16:28:37.937859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1488/2975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:37.948665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:37.949260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:37.955022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.955503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.955934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:37.956617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:37.957061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:37.958168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.106048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:38.115117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95d42868-bbb0-4606-81de-0b4fc71051be tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.313483 Sep 13 16:28:38.127131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1488/2976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:37 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:38.127131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:38.127131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:38.127131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.127680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.127801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.128465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.128927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.129970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.443744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:38.454184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:38.456306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:38.458067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aee51fc4-4de2-4c61-ad06-ae5562c15e34 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.518718 Sep 13 16:28:38.471283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1489/2977] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:38.553748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:38.556382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:38.564339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58ece606-827f-4eab-af82-2e50cdad02f1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1718 microversion: 2.1 time: 0.447813 Sep 13 16:28:38.565412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1489/2978] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1718 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:38.820671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:38.821737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:38.829320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.830584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.832116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.833642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.834415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.835248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.887509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-1bf28e67-76c1-426f-803c-6bc8f471ea4e req-637e988d-5737-49a5-83ac-7833cb935fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8c6aa1-3270-40d0-88f2-196f26018b5c", "name": "network-vif-deleted", "tag": "a5ace629-a258-4223-850a-b1429a8d3b28"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:28:38.899804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1bf28e67-76c1-426f-803c-6bc8f471ea4e req-637e988d-5737-49a5-83ac-7833cb935fd2 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.900304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1bf28e67-76c1-426f-803c-6bc8f471ea4e req-637e988d-5737-49a5-83ac-7833cb935fd2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.900919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1bf28e67-76c1-426f-803c-6bc8f471ea4e req-637e988d-5737-49a5-83ac-7833cb935fd2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.913132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-1bf28e67-76c1-426f-803c-6bc8f471ea4e req-637e988d-5737-49a5-83ac-7833cb935fd2 service nova] Creating event network-vif-deleted:a5ace629-a258-4223-850a-b1429a8d3b28 for instance de8c6aa1-3270-40d0-88f2-196f26018b5c on hv-cinder-82002 Sep 13 16:28:38.919297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-1bf28e67-76c1-426f-803c-6bc8f471ea4e req-637e988d-5737-49a5-83ac-7833cb935fd2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105070 Sep 13 16:28:38.919893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1490/2979] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:28:38.963629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:38.964611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:38.972374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.973008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.974012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:38.974997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:38.975673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:38.976292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.014416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.023621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d040db8-b4a8-43a4-8000-3d1accfaff9a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.207982 Sep 13 16:28:39.024212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1490/2980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:39.138016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.139192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:39.139812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:39.146037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:39.146527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:39.146996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.147700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:39.148033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6e43e505-ee66-4287-95e0-f2580829c258 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.188999 Sep 13 16:28:39.148350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:39.150938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.151302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1491/2981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:38 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:39.278733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.287772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e873732c-71dc-4feb-b444-83b4c50a285e tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.152461 Sep 13 16:28:39.288342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1491/2982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:39 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:39.484327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:39.485055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:39.492157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:39.492668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:39.493105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.493796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:39.494247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:39.494714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.589494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:39.590434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:39.597422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:39.597967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:39.599434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.599906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:39.600366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:39.600802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:39.630443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.639475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.640905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.642088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ddb6bd77-e276-4b5b-8f9c-d3bb06381985 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.161692 Sep 13 16:28:39.643131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1492/2983] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:39 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:39.668484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:39.677134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-262bc1d1-2322-4a0b-b8e4-8c748a61b28b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.091367 Sep 13 16:28:39.677715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1492/2984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:40.046779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:40.047419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:40.053507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.053990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.054431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.055154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.055611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.056040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.172271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:40.172877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:40.178760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.179271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.179709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.180394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.180846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.181267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.183461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.192148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b265aaa-c02b-463c-a8e0-2f1b93540d88 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148713 Sep 13 16:28:40.192845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1493/2985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:40 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:40.310962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:40.311651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:40.311791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.318404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.318991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.319522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.320319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.320569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10e3b60c-0db6-4229-9a4e-7f373b242b5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152227 Sep 13 16:28:40.320835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.321136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1493/2986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:40 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:40.321248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.450151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.458482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-934cac10-119e-4c99-b9a9-c7b238154124 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.151450 Sep 13 16:28:40.459097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1494/2987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:40 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:40.670764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:40.671334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:40.678522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.679027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.679466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.680149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.680595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.681016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.699997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:40.700687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:40.707061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.707901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.708527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.709216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:40.709665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:40.710090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:40.778726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.788304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0952e1e4-f506-4166-8462-abbc249f9c38 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.092349 Sep 13 16:28:40.788875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1495/2988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:40.834119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.842587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.844147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:40.845304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2756bf6d-3237-4bee-8a23-ee122fa178a9 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.178683 Sep 13 16:28:40.845851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1494/2989] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:40 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:41.215414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:41.216018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:41.222119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.222609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.223118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.223812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.224275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.224704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.344425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:41.345435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:41.351449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.351942 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.352389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.353116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.353570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.354001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.356855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:41.365714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0052a604-9496-4b29-be38-67acbf1ddb72 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154083 Sep 13 16:28:41.366304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1496/2990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:41.481278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:41.481893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:41.484966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:41.487839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.488335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.489491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.490194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.490669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.491125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.494081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac71dbfc-6ec3-4f73-9b15-465d24126f19 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.153499 Sep 13 16:28:41.494722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1495/2991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:41 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:41.618684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:41.627361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6258a03-4968-4b6f-a7ba-b93908de753c tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.149984 Sep 13 16:28:41.628206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1497/2992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:41 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:41.811436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:41.812039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:41.818430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.818923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.819357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.820033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.820475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.820893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.869570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:41.870093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:41.876452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.876937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.877366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.878050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:41.878500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:41.878973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:41.881855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:41.890003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-69232d39-93db-4954-bdbe-152dece8e21c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082328 Sep 13 16:28:41.890567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1496/2993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:42.009029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.017442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.018877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.020559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c36b11ec-1d5d-4e5a-ab47-b13c0466abdd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154347 Sep 13 16:28:42.021108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1498/2994] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:41 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:42.389496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:42.390100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:42.396129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.396606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.397046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.397729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.398178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.398601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.517627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:42.518344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:42.523994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.525138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.525617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.526050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.526741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.527235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.527660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.532209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98c81412-a9f0-4b2d-8427-d333769ee683 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146579 Sep 13 16:28:42.532881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1497/2995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:42.651715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:42.652325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:42.653577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.658095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.658566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.659023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.659706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.660148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.661505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.662427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67b35926-c3cc-4863-a201-cbab6ab3ea94 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148638 Sep 13 16:28:42.663023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1499/2996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:42 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:42.790454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.798610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77fa76cf-3448-47d2-a13f-5c0e0b84fe7f tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150835 Sep 13 16:28:42.799207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1498/2997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:42 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:42.914010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:42.914566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:42.920997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.921474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.921905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.922579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.923130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.923548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.986602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:42.994812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d503fd47-e6a2-4c0a-8499-028d8d36b88a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085169 Sep 13 16:28:42.995403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1500/2998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:43.045448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:43.046063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:43.052922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.053400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.053843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.054533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.055014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.055443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.186221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:43.195427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:43.196880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:43.198284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-73420270-b95a-4df9-b090-59872358d377 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156471 Sep 13 16:28:43.198839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1499/2999] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:43 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:43.556864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:43.557413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:43.563420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.563900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.564339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.565020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.565470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.565895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.685576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:43.686218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:43.692424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:43.693048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.693610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.694120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.694858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.695347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.695776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.700895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1386fd52-b1b3-4dcf-829d-9e00b23fc6e9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147900 Sep 13 16:28:43.701461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1501/3000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:43.822330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:43.822511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:43.823431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:43.829344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.829908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.830411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.830857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd1c505c-14da-4b1d-9f80-e1f931d3699b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149067 Sep 13 16:28:43.831245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:43.831454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1500/3001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:43 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:43.831862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:43.833000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:43.960599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:43.968755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d01a9d4c-d145-4dfc-bc0a-4349a9a6c2f6 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.150452 Sep 13 16:28:43.969312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1502/3002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:43 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:44.017536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:44.018155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:44.024340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.024826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.025266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.025954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.026408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.026837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.088943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:44.097095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54ec4e72-0bf1-46da-9c36-313e05f15dd2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083358 Sep 13 16:28:44.097655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1501/3003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:44.223989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:44.224606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:44.230507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.231026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.231468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.232153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.232614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.233041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.357991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:44.367339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:44.368768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:44.369967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efad1343-fa07-46d2-8546-9fe1ed96b8ca tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.150011 Sep 13 16:28:44.370518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1503/3004] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:44 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:44.724554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:44.725114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:44.726929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:44.732186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.732672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.733114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.733807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.734261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.734692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.867416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:44.875735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df0edc3e-d1c9-418f-b029-3ca1a1a2035b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.155601 Sep 13 16:28:44.876637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1502/3005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:44.926813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:44.927452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:44.933392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.933870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.934305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.935014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.935468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.935889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.991871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:44.992395 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] [instance: 325211a3-a74a-48fb-b693-e9340461ed2d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:44.998288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.998766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.999240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.999928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.000377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.000803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:45.107049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:45.116701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-579435d0-6771-4c27-98dc-3d91ee52ee11 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.265104 Sep 13 16:28:45.117368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1504/3006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:44 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:45.121802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:45.122510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:45.128278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.128759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.130386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:45.131125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.131588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.132020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:45.151931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313ac02befbf44ebabf3b41f84245c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673d53e0757746708c6ca7b9d947b409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:45.160111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cbf0677b-6610-4c8b-b41f-f5ad4b95f392 tempest-VolumesSnapshotTestJSON-1766466804 tempest-VolumesSnapshotTestJSON-1766466804-project] 10.222.0.50 "GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d" status: 200 len: 1557 microversion: 2.1 time: 0.172712 Sep 13 16:28:45.161210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1503/3007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:44 2022] GET /compute/v2.1/servers/325211a3-a74a-48fb-b693-e9340461ed2d => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:45.193694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:45.196154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:45.203805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-580ebca3-8c3b-4665-adf2-f9ede1672bc4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085487 Sep 13 16:28:45.204687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1505/3008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:45.396141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:45.396756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:45.403032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.403511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.403944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:45.404631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.405077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.405495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:45.530276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:45.539743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:45.541174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:45.542311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb46d3b3-12b9-4445-9e84-c595625519ac tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.150255 Sep 13 16:28:45.542857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1504/3009] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:45 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:28:45.899627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:45.900239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:45.906175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.906652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.907136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:45.907824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:45.908273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:45.908697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.037959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:46.046328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d63ab52-9c71-4732-8f2a-51acae52194b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151083 Sep 13 16:28:46.046921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1506/3010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:45 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:46.141961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:46.142570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:46.149967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:46.150391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:46.150823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.151541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:46.151988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:46.152410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.228748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:46.230604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:46.237071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:46.237550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:46.237982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.239724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:46.240181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:46.240607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.292091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:46.300427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd5bd402-4785-433b-8edc-bc03c647e375 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.162260 Sep 13 16:28:46.301628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1505/3011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:46 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:46.311766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:46.315528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b363c0f-cdb7-4ddd-8bbd-b734b48a3e73 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.092768 Sep 13 16:28:46.316089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1507/3012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:46.568408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:46.569018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:46.575172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:46.575656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:46.576091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.576775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:46.577225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:46.577648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:46.593197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:46.710928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:46.719467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:46.720909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:46.722060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f474a0e9-413d-4db6-94aa-167cc2ce678c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.158357 Sep 13 16:28:46.722616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1506/3013] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:46 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:47.069424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:47.070040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:47.076761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.077241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.077679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.078361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.078811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.079266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.205910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:47.214732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df21f4b0-7300-4bd9-a3bb-e55764c12615 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149278 Sep 13 16:28:47.215325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1508/3014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:47.325478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:47.326782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:47.334495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.335429 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.335711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.336417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.336866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.337292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.340394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:47.341029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:47.346789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.347292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.347723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.349595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.350042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.350460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.434269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:47.443108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1b5cee8-d747-4596-b602-22cbb0b19da1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.106410 Sep 13 16:28:47.443684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1509/3015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:47.491247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:47.499341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9cb90d88-709a-4708-9a06-16dae8a42278 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.177929 Sep 13 16:28:47.499906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1507/3016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:47 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:47.748416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:47.748945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:47.755747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.756240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.756674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.757356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:47.757805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:47.758229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:47.885284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:47.894138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:47.896426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:47.897566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9bb29f96-0511-4eef-9991-ff9882f917c2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153129 Sep 13 16:28:47.898114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1510/3017] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:47 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:48.238247 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:48.239447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:48.245471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.245945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.246377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.247091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.247546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.247971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.376092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:48.384245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52f8be15-99cb-49a8-a9d4-f829369c7594 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149841 Sep 13 16:28:48.384813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1508/3018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:48.467221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:48.467826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:48.474890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.475418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.475850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.476523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.476966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.477386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.523884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:48.524636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:48.530488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.531002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.531434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.532116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.532578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.532976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.538834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:48.547112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f311c391-1285-4e57-995c-bd4c42e6038e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084347 Sep 13 16:28:48.547679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1511/3019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:48.659770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:48.668503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bcf6dba-4836-4706-8698-04cd8430b8dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148977 Sep 13 16:28:48.669056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1509/3020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:48 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:48.923197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:48.923848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:48.929786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.930269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.930707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:48.931425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:48.931882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:48.932313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.003592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:28:49.003895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:28:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 (ip 10.222.0.50) !!! Sep 13 16:28:49.063311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:49.072775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:49.074481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:49.075658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45fe1f61-06b6-42ae-8989-5aee257e45dd tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156671 Sep 13 16:28:49.076208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1512/3021] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:48 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:49.407285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:49.407899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:49.414507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:49.415021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:49.415460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.416144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:49.416593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:49.417015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.542304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:49.550368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-752ae321-70a5-4cfb-a31b-aa4d3aedae89 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146926 Sep 13 16:28:49.551457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1510/3022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:49.571251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:49.571859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:49.578444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:49.578947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:49.579388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.580060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:49.580505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:49.580925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.645642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:49.653633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e6f7401-5ce3-459e-8feb-8c6336d76845 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086812 Sep 13 16:28:49.654187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1513/3023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:49.692094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:49.692818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:49.698970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:49.699449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:49.699882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.700565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:49.701018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:49.701442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:49.826030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:49.836186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8af8711f-115d-4ef3-8153-7ac574cd3054 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148448 Sep 13 16:28:49.837603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1511/3024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:49 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:50.101577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:50.102212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:50.104118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:50.109198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.109675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.110110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.110822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.111571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.112119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.239913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:50.248315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:50.249751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:50.250886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e90e2a4c-78e8-447e-bf1c-72a74e5ade5a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.154174 Sep 13 16:28:50.251528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1514/3025] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:50 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:50.573813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:50.574411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:50.580740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.581196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.581626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.582459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.582959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.583387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.675586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:50.677225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:50.683698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.684177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.684609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.685290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.685744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.686165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.719304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:50.728394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a8f52fd-b8dd-4945-a1d7-ff88e7caddbc tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.158606 Sep 13 16:28:50.728975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1512/3026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:50.749276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:50.757754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37b99f14-76eb-403b-9aaf-6d555c61d44e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086105 Sep 13 16:28:50.758303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1515/3027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:50.861782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:50.862391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:50.868329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.868808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.869237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.869921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:50.870369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:50.870789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:50.994691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:51.002760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5918d26-1858-46ed-9f36-354c08791072 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.144814 Sep 13 16:28:51.003356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1513/3028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:50 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:51.276237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:51.276943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:51.282780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:51.283294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:51.283728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:51.284413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:51.284863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:51.285290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:51.414744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:51.423351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:51.424796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:51.425996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45c48d14-cae5-4e59-9fdc-6fd12d0c3b54 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.153790 Sep 13 16:28:51.426610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1516/3029] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:51 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:51.752656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:51.753209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:51.760357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:51.760839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:51.761278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:51.761966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:51.762418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:51.762847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:51.780805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:51.781410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:51.787751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:51.788233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:51.788665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:51.789342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:51.789792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:51.790207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:51.866176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:51.874786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf2e9346-8d90-4f1b-9cc6-4f9688897ee6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.097735 Sep 13 16:28:51.875394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1517/3030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:51.914577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:51.922828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4e30c50-7a39-44cc-b880-0f57e6630b61 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.174138 Sep 13 16:28:51.923423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1514/3031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:52.026153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:52.026718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:52.032592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.033069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.033500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.034180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.034626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.035078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.161628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:52.169756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00073c15-e39a-488c-92e9-f3652475485e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.147479 Sep 13 16:28:52.170322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1518/3032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:52 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:52.453014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:52.453618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:52.460463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.460937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.461370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.462047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.462491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.462931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.588835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:52.597228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:52.599293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:52.600446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-200ae651-8d71-43cf-b319-0c9f2f6abc9a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151405 Sep 13 16:28:52.601001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1515/3033] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:52 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:52.898989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:52.899623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:52.905992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.906467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.906917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.907689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.908138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.908560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.946768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:52.947388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:52.954011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.954495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.954950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.955646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:52.956098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:52.956525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:52.973467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:52.981603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c541f8e6-72f0-468d-bfce-d403e4e43ec4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087371 Sep 13 16:28:52.982170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1519/3034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:53.086504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:53.094607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15d2b275-3826-4e66-bcf6-eacfaa8c21fd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151709 Sep 13 16:28:53.095205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1516/3035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:52 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:53.194230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:53.194758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:53.201060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:53.201532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:53.201960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:53.202636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:53.203119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:53.203538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:53.329642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:53.338892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-77cf1ff2-6ad8-4035-880e-f3598e0a90c9 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148687 Sep 13 16:28:53.339210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1520/3036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:53 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:53.625576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:53.626187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:53.632780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:53.633258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:53.633692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:53.634373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:53.634818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:53.635272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:53.765740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:53.774389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:53.775868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:53.777014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-acf316eb-3534-4ee2-8c7e-284cc0b82f15 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155339 Sep 13 16:28:53.777569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1517/3037] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:53 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:54.005260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:54.005871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:54.012284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.012759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.013190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.013863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.014310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.014731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.075334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:54.083609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbc61375-a8d6-43dc-8ec4-ca27e2a10592 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082884 Sep 13 16:28:54.084163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1521/3038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:54.117971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:54.118618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:54.125043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.125518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.125958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.126636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.127119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.127548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.256818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:54.264939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a0ea800-b324-411d-b3e6-31b5559abdc9 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151331 Sep 13 16:28:54.265496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1518/3039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:54.361257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:54.361895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:54.367889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.368370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.368805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.369493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.369942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.370361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.385427 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:54.498566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:54.507602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5777157f-ffea-42ce-a739-fed3d1fe8b96 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150212 Sep 13 16:28:54.508165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1522/3040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:54 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:54.802496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:54.803056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:54.809201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.809708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.810144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.810826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:54.811310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:54.811735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:54.941515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:54.950391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:54.951867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:54.953018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a4dfa1b-911a-4293-9684-3e7829b40839 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155310 Sep 13 16:28:54.953640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1519/3041] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:54 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:55.106247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:55.106653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:55.114118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.114708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.115207 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.115952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.116403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.116828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.183326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:55.191609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3862ef07-ebe1-4c1a-88dd-5e3070582417 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089750 Sep 13 16:28:55.192185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1523/3042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:55.289180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:55.289816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:55.296169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.296642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.297073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.297746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.298189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.298613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.425663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:55.433881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8f3f327-a82b-451c-9194-f68e355b44ca tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149422 Sep 13 16:28:55.434446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1520/3043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:55.529965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:55.530576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:55.532597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:28:55.532731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:28:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd (ip 10.222.0.50) !!! Sep 13 16:28:55.539847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.540324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.540756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.541439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.541891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.542319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.671184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:55.680351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e2e7de0-c73a-41e4-83b1-cb90c74b8a77 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.153948 Sep 13 16:28:55.680914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1524/3044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:55 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:55.977996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:55.978515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:55.984676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.985151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.985582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:55.986265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:55.986710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:55.987173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.134104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:56.143207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:56.144722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:56.146456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f45ccbf-a166-4bff-8605-8681810c9285 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.172121 Sep 13 16:28:56.147076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1521/3045] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:55 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:56.216577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:56.217390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:56.224011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:56.224489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:56.224922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.225605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:56.226241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:56.227058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.303600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:56.314772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5030492c-fbfa-4e21-89ca-ab275322c2b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.104028 Sep 13 16:28:56.315384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1525/3046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:56.457727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:56.458472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:56.466334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:56.466808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:56.467651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.468361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:56.468805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:56.469229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.619372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:56.626580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9db671b-6f3c-4e36-8190-2e2644f898e2 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.172775 Sep 13 16:28:56.627184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1522/3047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:56.705324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:56.705950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:56.712122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:56.712633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:56.713070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.713744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:56.714190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:56.714611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:56.843989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:56.852738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b057d2d-6938-4796-88e4-0ff84b51650a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151347 Sep 13 16:28:56.853302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1526/3048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:56 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:57.173817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:57.174341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:57.180293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.180768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.181199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.181872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.182317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.182730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.186578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:57.308046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:57.317148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:57.318626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:57.319792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e463d6fb-55df-4ccb-8fa1-72ec5317836f tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.149936 Sep 13 16:28:57.320351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1523/3049] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:57 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:57.340058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:57.341171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:57.347167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.347694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.348242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.348923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.349370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.349785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.413148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:57.421414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08935d1f-58b7-4699-b775-ef42813686a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085135 Sep 13 16:28:57.422143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1527/3050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:57.651679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:57.652353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:57.658633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.659148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.659566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.660313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.660975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.661397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.787907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:57.795915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6aba3900-38f4-4d73-9d46-53c25b49cc47 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148018 Sep 13 16:28:57.796474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1524/3051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:57 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:57.876153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:57.876764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:57.883746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.884238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.884726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:57.885405 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:57.885859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:57.886288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.011385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:58.020286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d11f8c3-0637-4e6f-9f67-45175aab00c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.147456 Sep 13 16:28:58.020851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1528/3052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:57 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:58.346335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:58.346973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:58.353767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:58.354249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:58.354686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.355558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:58.355995 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:58.356419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.444451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:58.445062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:58.451634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:58.452110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:58.452543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.453233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:58.453681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:58.454099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.486651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:58.495706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:58.497158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:58.498330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd8cdbb3-e6c4-4313-8beb-958377e731a5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.155944 Sep 13 16:28:58.500827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1525/3053] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:58 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:58.519382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:58.528198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-025f46ab-cfe5-46d9-b7da-85630ab52414 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088150 Sep 13 16:28:58.528757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1529/3054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:58.819899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:58.820432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:58.827356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:58.827830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:58.828258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.828934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:58.829377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:58.829796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:58.955878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:58.966188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-047be277-b121-493a-b864-7f35df3b07b0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150779 Sep 13 16:28:58.966999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1526/3055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:59.043934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:59.044546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:59.050500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.051608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.052222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.053166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.053620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.054041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.189012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:59.197707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38ed13a7-a7bd-456c-bc50-f60aca9117d0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.157666 Sep 13 16:28:59.198267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1530/3056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:59 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:28:59.524288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:59.524824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:59.530729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.531244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.531675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.532357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.533073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.533500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.551500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:59.552210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:59.558428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.558924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.559379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.560064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.560513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.560935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.627712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:59.636061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0b5957c-53d7-4a06-ae7d-dd608bd81fce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088991 Sep 13 16:28:59.636632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1531/3057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:59.687733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:59.696598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:59.698039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:28:59.699497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b799c0c-d0a9-4094-9fd7-9029f55b23bf tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.179972 Sep 13 16:28:59.700056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1527/3058] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:28:59 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:59.989549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:59.990147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:28:59.996088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.996566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.997002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:59.997679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:59.998128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:59.998550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.128264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:00.137132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95b84ff6-ebb0-4061-945e-db93929b6748 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151522 Sep 13 16:29:00.137703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1532/3059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:28:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:00.221454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:00.222097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:00.228579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:00.229082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:00.229517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.230201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:00.230650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:00.231115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.355629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:00.363972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d1b4bf4-04a0-45d4-8cca-8589b7e591df tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.146300 Sep 13 16:29:00.364545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1528/3060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:00 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:00.660862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:00.661466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:00.667737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:00.668216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:00.668646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.669319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:00.669762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:00.670180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.724939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:00.725543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:00.731937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:00.732411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:00.732847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.733526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:00.733972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:00.734393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:00.741054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:00.749575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac44b52b-f173-4122-befb-a1fd9ccfb035 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.092771 Sep 13 16:29:00.750148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1533/3061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:00.861574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:00.870858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:00.872313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:00.873453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4cd6e277-d430-4d62-8215-6f3718a8473a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152812 Sep 13 16:29:00.874004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1529/3062] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:00 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:01.160993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:01.161601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:01.167552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.168035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.168473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.169156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.169615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.170040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.301429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:01.309720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e85e28bc-e5e1-41f5-9048-9f1327d5787c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153240 Sep 13 16:29:01.310303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1534/3063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:01.388161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:01.388802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:01.395406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.396024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.396452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.397134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.397586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.398012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.530100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:01.538852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d2ce209-abc1-4ff0-95f0-1448dd3c0d93 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154487 Sep 13 16:29:01.539453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1530/3064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:01 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:01.774767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:01.775337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:01.781750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.782231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.782671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.783659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.784219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.784631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.845579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:01.853896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8155a850-8912-4cbf-93c3-a691d6508f10 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084846 Sep 13 16:29:01.854470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1535/3065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:01.900049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:01.900653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:01.906988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.907466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.907897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:01.908577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:01.909023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:01.909443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.035410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:02.044185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:02.045636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:02.046840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66585953-3b5a-48ea-b4f1-a59ab677d0b7 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.150644 Sep 13 16:29:02.047425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1531/3066] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:01 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:02.333676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:02.334353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:02.340537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:02.341027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:02.341470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.342162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:02.342615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:02.343071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.472064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:02.480849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3cc2bb3f-9b79-4c2d-9983-b29d93f13d76 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151223 Sep 13 16:29:02.481415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1536/3067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:02.561465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:02.562073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:02.568138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:02.568608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:02.569034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.569709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:02.570153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:02.570568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.652459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:29:02.652595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd (ip 10.222.0.50) !!! Sep 13 16:29:02.699254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:02.707499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0486d035-e0da-4f4d-8f94-a5450354525a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149744 Sep 13 16:29:02.708151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1532/3068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:02 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:02.876419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:02.877084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:02.883585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:02.884061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:02.884492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.885170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:02.885614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:02.886033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:02.949402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:02.958028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b874e33a-813f-4408-83d0-c7eca00f4c5c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085331 Sep 13 16:29:02.958689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1537/3069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:03.073170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:03.074030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:03.082832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.083471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.083907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.084592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.085040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.085459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.213602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:03.222074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:03.224216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:03.225375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e78d1e8-0905-40b0-a70f-790727aa959a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.156068 Sep 13 16:29:03.225932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1533/3070] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:03 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:03.504461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:03.505004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:03.510948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.511438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.511875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.512561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.513010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.513432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.639311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:03.648249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c0bb59a-1f34-4dc6-a034-b3d31b0b8043 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147748 Sep 13 16:29:03.648823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1538/3071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:03 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:03.731831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:03.732445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:03.738303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.738775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.739239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.739997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.740461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.740883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.981611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:03.982247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:03.988757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.989245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.990496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.991230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:03.991688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:03.992114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:03.994886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:04.110935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:04.120710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fd57fea-0a1b-416c-9beb-b2124e601dbf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.392556 Sep 13 16:29:04.121378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1534/3072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:03 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:04.207211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:04.215924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-89e23972-055d-4e0d-b409-bead646d3006 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.238207 Sep 13 16:29:04.216489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1539/3073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:04.250382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:04.251026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:04.257077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:04.257553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:04.257987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:04.258669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:04.259147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:04.259574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:04.387206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:04.396475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:04.397983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:04.399182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2af623ba-74ed-4a12-ad3b-e420a8971ea2 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152619 Sep 13 16:29:04.399738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1535/3074] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:04 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:04.671934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:04.672539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:04.678486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:04.678995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:04.679434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:04.680113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:04.680565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:04.680990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:04.805274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:04.813792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e76ad44-3c42-4e35-9572-1b7d6e1651c0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.145667 Sep 13 16:29:04.814360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1540/3075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:05.144982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:05.145600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:05.152013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.152498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.152943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.153636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.154088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.154553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.239175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:05.240887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:05.247111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.247670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.248184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.248942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.249408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.249830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.281654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:05.290289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c42019d-35a1-4e76-a8c1-0ea1774a6aa5 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149157 Sep 13 16:29:05.290870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1536/3076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:05 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:05.313460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:05.322394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a2d59028-067f-4a7d-be30-2b81457f5e40 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087074 Sep 13 16:29:05.322913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1541/3077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:05.424814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:05.425425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:05.431963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.432450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.432907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.433574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.434024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.434449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.559922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:05.568709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:05.570162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:05.571337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3267621f-2923-412e-9b8f-08fb380d1a95 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.150359 Sep 13 16:29:05.571907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1537/3078] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:05 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:05.837506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:05.838113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:05.844047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.844523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.844954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.845630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:05.846070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:05.846487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:05.971473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:05.980257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e11e6d03-1481-46f1-a637-df42f2400027 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147277 Sep 13 16:29:05.980812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1542/3079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:06.314514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:06.315098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:06.322083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:06.322555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:06.323003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:06.323935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:06.324377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:06.324795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:06.345440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:06.346189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:06.352918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:06.353400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:06.353837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:06.354523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:06.355006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:06.355438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:06.421841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:06.430630 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9fc268d-216b-43b2-a9e5-b8aba3081ab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088979 Sep 13 16:29:06.431225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1543/3080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:06.478449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:06.486586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-646951b3-1cc0-47f4-bc57-4e02e2e7ab82 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.176102 Sep 13 16:29:06.487181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1538/3081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:06 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:06.595871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:06.596486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:06.602635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:06.603152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:06.603594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:06.604282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:06.604734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:06.605161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:06.732441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:06.741729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:06.743195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:06.744354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8a9f509-d4a9-4275-bdd6-4f76e91598b8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.152373 Sep 13 16:29:06.744908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1544/3082] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:06 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:07.003248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:07.003857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:07.009975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.010457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.010891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.011589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.012034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.012456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.140153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:07.142308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:07.149534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d1d5481-ecfd-4b97-9ae3-b4e07cfa2183 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150110 Sep 13 16:29:07.150102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1539/3083] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:07.453804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:07.454344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:07.461379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.461859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.462295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.463009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.463469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.463918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.509506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:07.510098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:07.516452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.516932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.517366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.518059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.518508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.518951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.526252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:07.534184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-178c5580-b6e2-403e-ad08-a6f5a7379ba7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084333 Sep 13 16:29:07.534746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1545/3084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:07.649383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:07.657760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c42faa9-619f-4d9f-950f-b3c23e8a4e3b tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152146 Sep 13 16:29:07.658318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1540/3085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:07 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:07.769967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:07.770489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:07.777090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.777566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.777993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.778673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:07.779149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:07.779573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:07.906737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:07.915328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:07.916802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:07.917959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54d808d5-4283-40f7-8da2-8c47b64cc927 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 200 len: 1804 microversion: 2.20 time: 0.151946 Sep 13 16:29:07.918517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1546/3086] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:07 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:07.945040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bdf1172-6255-4847-9ec0-242055596386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '.version_select at 0x7fb67fae3430>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:07.966674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bdf1172-6255-4847-9ec0-242055596386 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501695922" status: 204 len: 0 microversion: 2.20 time: 0.026404 Sep 13 16:29:07.967257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1541/3087] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Sep 13 16:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501695922 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:29:08.173150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:08.173764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:08.180318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:08.180803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:08.181241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:08.181955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:08.182409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:08.182835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:08.408722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:08.417832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85c02888-1a2e-46a8-90f5-16a311302997 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.248499 Sep 13 16:29:08.418406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1547/3088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:08.559435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:08.559984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:08.565748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:08.566221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:08.566711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:08.567425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:08.567871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:08.568291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:08.648855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:08.656990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3ae5c5d-a2e1-4155-ac7a-33d2638fba5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.102024 Sep 13 16:29:08.657561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1542/3089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:08.681769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:08.682413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:08.688769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:08.689260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:08.689703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:08.690401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:08.690857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:08.691313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:08.890681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:08.899305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c88fae1-adbd-42af-948b-74b3baf77589 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221787 Sep 13 16:29:08.899876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1548/3090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:08 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:09.033758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-d660802d-60b8-490f-9ceb-b73e3cd14991 req-ae0cac6d-7552-4ec1-91cd-7acb93bafaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:09.044817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d660802d-60b8-490f-9ceb-b73e3cd14991 req-ae0cac6d-7552-4ec1-91cd-7acb93bafaa0 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.045581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d660802d-60b8-490f-9ceb-b73e3cd14991 req-ae0cac6d-7552-4ec1-91cd-7acb93bafaa0 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.046165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d660802d-60b8-490f-9ceb-b73e3cd14991 req-ae0cac6d-7552-4ec1-91cd-7acb93bafaa0 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:09.063809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-d660802d-60b8-490f-9ceb-b73e3cd14991 req-ae0cac6d-7552-4ec1-91cd-7acb93bafaa0 service nova] Creating event network-changed:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:29:09.070217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-d660802d-60b8-490f-9ceb-b73e3cd14991 req-ae0cac6d-7552-4ec1-91cd-7acb93bafaa0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040082 Sep 13 16:29:09.070957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1543/3091] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:09.256763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e390487-ee4b-41f4-9eed-92829863dd47 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'create', calling method: .version_select at 0x7fb67c136ca0>, body: {"keypair": {"name": "tempest-keypair-1040484790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9pfPBFI94jaDQ0+8entthEvBamq4yNCIIwCfMFgz0nuurVu8IFxR8okJzUooFWm3qaEKGn2Pg0X+a/6Iq61V3bAKlUztdHCWmjZ5K3792pgQozP9kAYqvpzO9bJhZDKw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:09.272986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-8e390487-ee4b-41f4-9eed-92829863dd47 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for project 859cfa45a18845f49e525ab4ed54b529. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:29:09.279716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-8e390487-ee4b-41f4-9eed-92829863dd47 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for user c0fd4bbe430b4a8888f3be4b23982c5a and project 859cfa45a18845f49e525ab4ed54b529. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:29:09.312065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e390487-ee4b-41f4-9eed-92829863dd47 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059344 Sep 13 16:29:09.313348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1549/3092] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Sep 13 16:29:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:29:09.441996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:09.442700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:09.451183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.452099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.452817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:09.454127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.455019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.455684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:09.680109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:09.681673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:09.688146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.689294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.689966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:09.690657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.691339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.691760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:09.746456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:09.755841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc1cb7b7-b3ec-4002-8c34-b9b63894ddb0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.317976 Sep 13 16:29:09.756711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1544/3093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:09.784792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:09.794211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85e8ea58-a0df-43ba-a8e1-6242adf1a53d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.117961 Sep 13 16:29:09.807296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1550/3094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:09.923266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:09.923882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:09.931250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.931690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.932143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:09.933228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:09.933589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:09.934408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:10.157558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:10.165868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ad389c7-7796-422a-9025-5902e378d436 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.246571 Sep 13 16:29:10.166567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1545/3095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:09 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:10.780736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:10.781478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:10.788527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:10.789003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:10.789439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:10.790447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:10.790920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:10.791350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:10.818517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:10.824369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:10.831246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:10.831730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:10.832160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:10.833056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:10.833502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:10.834131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:10.905093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:10.913962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9aa8b47d-60c2-4746-992b-742a4626912e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.099551 Sep 13 16:29:10.914628 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1546/3096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:10.919593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822332137", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7a71916-0d63-4fd1-9b48-ca6da518cd37"}], "security_groups": [{"name": "tempest-securitygroup--1851172309"}], "key_name": "tempest-keypair-1040484790", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:10.952586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:10.962674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e6aaa4a-c95e-4ad9-a0e2-5c1e77e3f259 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.186134 Sep 13 16:29:10.963605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1551/3097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:10 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:11.022068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] validate_networks() for [('c7a71916-0d63-4fd1-9b48-ca6da518cd37', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:29:11.191421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:11.192044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:11.198232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.199054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.199491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.200176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.200621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.201039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.399782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:11.408658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2c625e8-641a-4e7e-b4e4-56be878e1b4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.221349 Sep 13 16:29:11.409223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1552/3098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:11 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:11.509397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:29:11.509824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:29:11.510306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:29:11.510721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:29:11.511176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:29:11.519904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.520384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.520820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.522169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.522611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.523079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.539483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for project 859cfa45a18845f49e525ab4ed54b529. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:29:11.541648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:11.544195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Getting quotas for user c0fd4bbe430b4a8888f3be4b23982c5a and project 859cfa45a18845f49e525ab4ed54b529. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:29:11.556816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:29:11.559109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:29:11.606147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c5a3800f-c0b0-4904-9129-97204c7bf280 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.690443 Sep 13 16:29:11.606803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1547/3099] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Sep 13 16:29:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:29:11.617870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d50805f1-09bc-46bb-a365-54e64036e425 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:11.618573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d50805f1-09bc-46bb-a365-54e64036e425 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:11.676320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d50805f1-09bc-46bb-a365-54e64036e425 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:11.684466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d50805f1-09bc-46bb-a365-54e64036e425 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:11.685948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d50805f1-09bc-46bb-a365-54e64036e425 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:11.687067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d50805f1-09bc-46bb-a365-54e64036e425 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1281 microversion: 2.20 time: 0.073136 Sep 13 16:29:11.687923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1553/3100] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:11 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:11.939664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:11.940857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:11.948500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.949238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.949694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.950400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.950851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.951298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.987218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:11.987884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:11.995800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.996791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.997492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:11.998591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:11.999300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:11.999834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:12.014365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:12.024137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d1202ab-fa6f-4e66-a11c-b158c0dd834b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089341 Sep 13 16:29:12.024967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1548/3101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:12.140347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:12.149012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b0503ab0-cfe7-41b1-8228-03e11e99a781 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.166008 Sep 13 16:29:12.149575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1554/3102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:12.433582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:12.434188 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:12.440084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:12.440564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:12.441015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:12.441674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:12.442122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:12.442539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:12.573860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:12.581951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d9189ba-7be0-4acd-b00f-8b279dfa09a6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152366 Sep 13 16:29:12.582510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1549/3103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:12 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:12.714161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:12.714767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:12.721653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:12.722172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:12.722662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:12.723385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:12.723865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:12.724292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:12.790799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:12.799169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:12.800865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:12.802066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-deb77939-99eb-4345-9810-af3b357f7c51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1333 microversion: 2.20 time: 0.092148 Sep 13 16:29:12.802887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1555/3104] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:12 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:13.047654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:13.048276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:13.055141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.055626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.056071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.056770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.057230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.057667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.123257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:13.133267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3cc2f7a5-f6be-4605-b296-f8b4e66988ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089463 Sep 13 16:29:13.133833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1550/3105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:13.172464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:13.173015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:13.180337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.180817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.181252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.181940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.182389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.182809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.386147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:13.394537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-77275e6f-a838-42d4-a7b0-add29f35b3ba tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.226001 Sep 13 16:29:13.395142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1556/3106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:13 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:13.606572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:13.607283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:13.613789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.614275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.614820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.616154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.616609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.616977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.828241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:13.828859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:13.835179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.835672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.836118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:13.836829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:13.837286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:13.837715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:14.099416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:14.107836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be7ad648-6485-422c-879c-7db4478c4654 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.505237 Sep 13 16:29:14.108406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1551/3107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:13 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:14.157139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:14.157828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:14.163783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:14.164278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:14.164716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:14.165413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:14.165874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:14.166301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:14.226236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:14.228445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:14.235547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:14.236979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:14.238083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a348738-9c4b-4fde-bc00-965658caa275 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1407 microversion: 2.20 time: 0.413808 Sep 13 16:29:14.238633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1557/3108] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:13 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:14.246036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:14.254687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-275460ad-1903-4aca-9ab8-27265c8fc73f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.101419 Sep 13 16:29:14.266993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1552/3109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:14.418696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:14.419329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:14.421130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:14.426070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:14.426561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:14.427025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:14.427800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:14.428909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:14.429338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:14.636710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:14.645025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4783f2ce-c997-418a-adcc-01f1dbf138c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.230382 Sep 13 16:29:14.645590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1558/3110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:14 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:14.772500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-9f1454fa-ae17-40a1-9d4b-1d1cd9b5d369 req-f5155c0c-8aff-4671-9b08-c6c2d5967fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad470a6-0ff7-41e3-a0d0-887c468ce0b6", "tag": "d002dcad-7194-4479-8406-a5f1f26495e5"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:14.782125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9f1454fa-ae17-40a1-9d4b-1d1cd9b5d369 req-f5155c0c-8aff-4671-9b08-c6c2d5967fc2 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:14.782599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9f1454fa-ae17-40a1-9d4b-1d1cd9b5d369 req-f5155c0c-8aff-4671-9b08-c6c2d5967fc2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:14.783055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9f1454fa-ae17-40a1-9d4b-1d1cd9b5d369 req-f5155c0c-8aff-4671-9b08-c6c2d5967fc2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:14.795793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-9f1454fa-ae17-40a1-9d4b-1d1cd9b5d369 req-f5155c0c-8aff-4671-9b08-c6c2d5967fc2 service nova] Creating event network-changed:d002dcad-7194-4479-8406-a5f1f26495e5 for instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 on hv-cinder-82002 Sep 13 16:29:14.800812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-9f1454fa-ae17-40a1-9d4b-1d1cd9b5d369 req-f5155c0c-8aff-4671-9b08-c6c2d5967fc2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Sep 13 16:29:14.801371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1553/3111] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:29:15.132337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:15.132985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:15.139019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.139507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.139949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.140642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.141098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.141526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.264755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:15.265493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:15.272286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.272816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.273302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.274008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.274706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.275180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.281861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:15.290975 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d07d5143-1242-46d3-a7b9-040b04ba634e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.163164 Sep 13 16:29:15.291554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1559/3112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:15 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:15.296148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:15.296755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:15.302783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.303315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.304123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.304829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.305286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.305716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.374287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:15.383358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fdebc006-6ce1-4e91-9c4c-85eecbffa700 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.090636 Sep 13 16:29:15.383955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1560/3113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:15.430226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:15.438283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:15.439735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:15.440818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0e17d7a-2cc4-4ccf-b30d-c40c20a3312c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1407 microversion: 2.20 time: 0.180802 Sep 13 16:29:15.441363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1554/3114] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:15 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:15.668438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:15.668997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:15.674948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.675435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.675872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.676556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:15.677008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:15.677433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:15.808632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:15.816727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83960ddf-c8e5-46f6-80ee-690fe3a142b5 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152249 Sep 13 16:29:15.817283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1561/3115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:15 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:16.314632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:16.315293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:16.321878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.322359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.322797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.323512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.324234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.324660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.408299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:16.408917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:16.416548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.417042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.417485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.418196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.418653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.419132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.510045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:16.518485 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1be42c7-7274-4605-b0ee-7c4c0715aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.114779 Sep 13 16:29:16.519079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1562/3116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:16.540430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:16.541046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:16.546778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.547283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.547719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.548393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.548836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.549256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.567069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:16.576665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bf23ef5-370f-4084-b8b4-c1c4a6dcd85f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.266020 Sep 13 16:29:16.577229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1555/3117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:16 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:16.697160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:16.705455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:16.706914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:16.708028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a68d34b-5df4-4651-a166-76f61a2c7cfc tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1407 microversion: 2.20 time: 0.172484 Sep 13 16:29:16.708583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1563/3118] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:16 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:16.841039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:16.841644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:16.847608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.848085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.848516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.849192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:16.849816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:16.850581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:16.977134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:16.985218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f78fb33-4ceb-4f15-a981-fe7b17b3f704 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147958 Sep 13 16:29:16.985786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1556/3119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:16 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:17.542534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:17.543171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:17.549484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:17.549967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:17.550401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:17.551117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:17.551563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:17.551984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:17.601234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:17.602168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:17.608700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:17.609264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:17.609768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:17.611140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:17.611140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:17.611702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:17.618137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:17.628283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d87dab9-4816-4119-9189-da494277b3e1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089534 Sep 13 16:29:17.629201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1564/3120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:17.733392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:17.734241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:17.740454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:17.740809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:17.741263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:17.741958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:17.742480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:17.742931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:17.748570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:17.756781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4590f134-0f93-43ff-9321-3a1f48ee9e27 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.160280 Sep 13 16:29:17.757351 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1557/3121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:17 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:17.869253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:17.877138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:17.878584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:17.879704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e3906664-7361-41b2-93b4-55275e8cc1d5 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1407 microversion: 2.20 time: 0.150217 Sep 13 16:29:17.880256 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1565/3122] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:17 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:18.008577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:18.009220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:18.015076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.015565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.016181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.016879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.017330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.017758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.303775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:18.311726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22835a27-6c7b-4a9e-b29e-bb6faa6046cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.307122 Sep 13 16:29:18.312281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1558/3123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:18 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:18.651245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:18.651856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:18.658081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.658554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.659016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.659691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.660156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.660558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.723081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:18.731950 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-39a89882-1863-4bee-a2e9-6264d15accc6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084470 Sep 13 16:29:18.732512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1566/3124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:18.779871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:18.780532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:18.786864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.787407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.787836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.788517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.788967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.789390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.804480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:18.905054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:18.905596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:18.911511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.912553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.913094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.913840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:18.914293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:18.914718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:18.918665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:18.926971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bca16d3b-1bbb-4d58-9e87-040a8bddff4e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150910 Sep 13 16:29:18.927532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1559/3125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:18 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:19.046646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:19.055645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:19.057078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:19.058188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83ef70be-665b-4760-8b9e-f8d9ec87b4fe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1407 microversion: 2.20 time: 0.157211 Sep 13 16:29:19.058846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1567/3126] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:18 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:19.335344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:19.335960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:19.341846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.342329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.342770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:19.343487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.343941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.344369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:19.472883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:19.483939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88b04e76-2ed7-4a75-af3e-d0dd47d41c3c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152907 Sep 13 16:29:19.484585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1560/3127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:19 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:19.664594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-15a08d4c-84c1-45a2-a9f8-c9ad3fe557db req-0de7adfb-93b1-422e-b022-bc0256cdb660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad470a6-0ff7-41e3-a0d0-887c468ce0b6", "name": "network-vif-plugged", "status": "completed", "tag": "d002dcad-7194-4479-8406-a5f1f26495e5"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:19.674070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-15a08d4c-84c1-45a2-a9f8-c9ad3fe557db req-0de7adfb-93b1-422e-b022-bc0256cdb660 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.674542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-15a08d4c-84c1-45a2-a9f8-c9ad3fe557db req-0de7adfb-93b1-422e-b022-bc0256cdb660 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.674995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-15a08d4c-84c1-45a2-a9f8-c9ad3fe557db req-0de7adfb-93b1-422e-b022-bc0256cdb660 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:19.686038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-15a08d4c-84c1-45a2-a9f8-c9ad3fe557db req-0de7adfb-93b1-422e-b022-bc0256cdb660 service nova] Creating event network-vif-plugged:d002dcad-7194-4479-8406-a5f1f26495e5 for instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 on hv-cinder-82002 Sep 13 16:29:19.690976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-15a08d4c-84c1-45a2-a9f8-c9ad3fe557db req-0de7adfb-93b1-422e-b022-bc0256cdb660 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086206 Sep 13 16:29:19.691546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1568/3128] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:19.757450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:19.758430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:19.764437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.765022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.765464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:19.766814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.766998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.767431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:19.840930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:19.849132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed53802d-3f7f-4c3a-831a-9f91570eb610 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.096797 Sep 13 16:29:19.849626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1561/3129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:19.951291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:19.951986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:19.958001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.958475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.958961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:19.959643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:19.960118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:19.960623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.083013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:20.084575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:20.088531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:20.090441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:20.091358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:20.091806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.092508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:20.092972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:20.093401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.097384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78bb43b3-7583-4411-a2fc-c439ce015918 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150583 Sep 13 16:29:20.097956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1569/3130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:19 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:20.227479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:20.235545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:20.236992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:20.238093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb17b58f-5a6c-4387-968f-116dee5b64a3 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1407 microversion: 2.20 time: 0.159001 Sep 13 16:29:20.238644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1562/3131] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:20 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:20.508639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:20.509177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:20.515104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:20.515583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:20.516017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.516692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:20.517139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:20.517576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.641355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:20.649749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-60fce613-a4c9-49d8-a10f-c33d6e5eb740 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.145338 Sep 13 16:29:20.650314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1570/3132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:20 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:20.872187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:20.872795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:20.879135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:20.879610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:20.880042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.880754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:20.881370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:20.881792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:20.941617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:20.950037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d39196d-5735-49ad-b57a-a791abe68379 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081666 Sep 13 16:29:20.950597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1563/3133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:21.121758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:21.122449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:21.128824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.129294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.129723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.130393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.131376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.131800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.262283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:21.262909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:21.263683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:21.268783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.269239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.269673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.270365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.270813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.271265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.272678 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd099da5-359f-4036-9af7-a3ad2ae65889 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154812 Sep 13 16:29:21.273246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1571/3134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:21 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:21.408951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:21.417371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:21.418929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:21.420117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7fe86369-3214-474b-9d0c-95458472a6ba tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1599 microversion: 2.20 time: 0.161776 Sep 13 16:29:21.420745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1564/3135] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:29:21 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:29:21.446242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:21.446738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:21.453163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.453872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.454506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.455224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.455681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.456103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.556532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4d00732-ba5a-4c84-b700-33af30f07b51 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115156 Sep 13 16:29:21.557211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1572/3136] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Sep 13 16:29:21 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:29:21.673551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:21.674397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:21.676271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:21.677041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:21.683343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.683491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.683859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.684581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.685011 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.685645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.970599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:21.975676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:21.976387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:21.982650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.983177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.983624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.984086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:21.984556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:21.984753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:21.985178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:21.995545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96f0b660-ae70-45fb-a559-7a785430c2cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.325649 Sep 13 16:29:21.996561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1565/3137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:21 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:22.129525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:22.137809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9ab4b45-3e09-4cc5-b394-639c9de376c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.168180 Sep 13 16:29:22.138378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1573/3138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:22.296868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:22.297552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:22.304236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:22.304731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:22.305166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:22.306001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:22.306494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:22.306946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:22.722837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:22.731214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d66700e6-06a8-4555-b9fa-8ee8164ac776 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.438258 Sep 13 16:29:22.731898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1566/3139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:22 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:23.023152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:23.023800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:23.029706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.030221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.030663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.031407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.031866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.032292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.160986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:23.161572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:23.168160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.168645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.169107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.169803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.170314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.170745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.254704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:23.263573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d23e398-a079-42a4-84e7-6c05a09c36c2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.106375 Sep 13 16:29:23.264002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:23.272215 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b339ddc-2eb7-4c4e-a585-ac6e92472cc0 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.253003 Sep 13 16:29:23.272779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1574/3140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:23 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:23.275386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1567/3141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:23.352912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3780dd74-bdf9-44c2-9b61-c71ccc8abb4b req-b51b7ba0-8a13-4331-a840-d03599f8b6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad470a6-0ff7-41e3-a0d0-887c468ce0b6", "tag": "d002dcad-7194-4479-8406-a5f1f26495e5"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:23.362389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3780dd74-bdf9-44c2-9b61-c71ccc8abb4b req-b51b7ba0-8a13-4331-a840-d03599f8b6a2 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.362867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3780dd74-bdf9-44c2-9b61-c71ccc8abb4b req-b51b7ba0-8a13-4331-a840-d03599f8b6a2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.363322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3780dd74-bdf9-44c2-9b61-c71ccc8abb4b req-b51b7ba0-8a13-4331-a840-d03599f8b6a2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.375566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3780dd74-bdf9-44c2-9b61-c71ccc8abb4b req-b51b7ba0-8a13-4331-a840-d03599f8b6a2 service nova] Creating event network-changed:d002dcad-7194-4479-8406-a5f1f26495e5 for instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 on hv-cinder-82002 Sep 13 16:29:23.380506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3780dd74-bdf9-44c2-9b61-c71ccc8abb4b req-b51b7ba0-8a13-4331-a840-d03599f8b6a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032459 Sep 13 16:29:23.381674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1575/3142] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:23.755619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:23.757052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:23.762319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.762804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.763270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.764182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:23.764637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:23.765069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:23.969659 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:23.978280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c2e2b29-e92c-41a9-b4dc-d9d36f2645c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.226517 Sep 13 16:29:23.979299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1568/3143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:23 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:24.288186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:24.288798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:24.295505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:24.295726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:24.295883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:24.296369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:24.297040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:24.297217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:24.297499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:24.297920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:24.304292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:24.305205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:24.305770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:24.306271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:24.307113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:24.307643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:24.308271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:24.392221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:24.400444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f4db73d-2788-4e1d-9403-3689f61acd51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.117760 Sep 13 16:29:24.401013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1576/3144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:24.460271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:24.468472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24719f52-2e09-45ed-af3d-017c52a1310a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.176580 Sep 13 16:29:24.469026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1569/3145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:24 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:25.003558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:25.004169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:25.010753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:25.011261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:25.011690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:25.012364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:25.012921 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:25.013340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:25.143046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:25.151875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a3a0242-a024-4f7e-8a00-1e4468300d47 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.152197 Sep 13 16:29:25.152432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1577/3146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:24 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:25.425297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:25.425917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:25.433842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:25.434328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:25.434766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:25.436034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:25.436522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:25.436961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:25.493527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:25.494143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:25.500749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:25.501304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:25.501787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:25.502224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:25.502924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:25.503382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:25.503803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:25.509705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8137e43-31bb-4e39-8cb4-0608e2faf162 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088236 Sep 13 16:29:25.510288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1570/3147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:25.633162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:25.641283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-438b8b47-21b4-4cdc-9ad7-e2e88a9d8af7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152291 Sep 13 16:29:25.641847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1578/3148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:25 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:26.175748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:26.176358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:26.182425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:26.182918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:26.183357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:26.184035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:26.184485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:26.184905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:26.309821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:26.317897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a6fff1d-d663-4cf2-b970-6e0e71745111 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.145986 Sep 13 16:29:26.319045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1571/3149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:26 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:26.532375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:26.532987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:26.539436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:26.539913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:26.540349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:26.541022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:26.541470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:26.541888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:26.601940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:26.610024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d2bde71-f623-4eb8-87e2-bd5cdf42f40f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081570 Sep 13 16:29:26.610584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1579/3150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:26.664295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:26.664932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:26.671294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:26.671788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:26.672229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:26.672922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:26.673378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:26.673808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:26.804171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:26.812283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dcd85a0e-4a39-4d8a-a622-6f8032961452 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151850 Sep 13 16:29:26.812844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1572/3151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:26 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:27.342696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:27.343332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:27.349928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:27.350574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:27.351055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:27.351747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:27.352199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:27.352625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:27.479305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:27.487398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f9c1c08-d0a4-464f-969a-6311718d3f52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.148606 Sep 13 16:29:27.487961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1580/3152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:27 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:27.632174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:27.632713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:27.638617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:27.639127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:27.639566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:27.640255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:27.640711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:27.641134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:27.701936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:27.710754 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddf995da-d503-4e00-abb8-2a36d86a1a5d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082579 Sep 13 16:29:27.711383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1573/3153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:27.835842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:27.836452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:27.842827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:27.843340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:27.843773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:27.844455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:27.844909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:27.845331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:27.974879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:27.982934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d56be816-6667-49f2-a59f-3e75a0e448db tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151483 Sep 13 16:29:27.983499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1581/3154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:27 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:28.510972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:28.511616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:28.517516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:28.517993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:28.518427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:28.519142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:28.519601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:28.520020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:28.644714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:28.653090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-989dcce7-f84b-47c5-aa41-ad00c4958873 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.145983 Sep 13 16:29:28.653644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1574/3155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:28 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:28.734556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:28.735205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:28.741982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:28.742453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:28.742940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:28.743620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:28.744063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:28.744483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:28.804181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:28.812283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fdd2fc48-d372-4bad-bb39-8400c5cae754 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081479 Sep 13 16:29:28.812835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1582/3156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:29.005654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:29.006373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:29.012772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:29.013259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:29.013701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:29.014396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:29.014855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:29.015322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:29.144783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:29.153661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d4085b7-dd29-44a4-a6a8-690fcc773aeb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151997 Sep 13 16:29:29.154209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1575/3157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:29 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:29.677044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:29.678420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:29.684892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:29.685367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:29.685794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:29.686466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:29.686929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:29.687352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:29.814239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:29.823110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c78e1b90-7c7b-47aa-a7e7-8c253c8ed911 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.149903 Sep 13 16:29:29.823675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1583/3158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:29 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:29.835358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:29.836053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:29.842004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:29.842484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:29.842944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:29.843634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:29.844089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:29.844513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:29.848342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:29.906594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:29.914876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a52a2ff2-f051-47d4-b1f2-eb47f500636b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083321 Sep 13 16:29:29.915451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1576/3159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:30.177463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:30.177930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:30.183863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:30.184365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:30.184794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:30.185497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:30.185965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:30.186382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:30.314449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:30.323156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0591658a-9ecc-45db-8688-ca6f92c13f28 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149616 Sep 13 16:29:30.323722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1584/3160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:30 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:30.846276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:30.847146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:30.854415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:30.854948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:30.855363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:30.856059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:30.856514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:30.856940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:30.937941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:30.938704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:30.945530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:30.946023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:30.946460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:30.947180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:30.947636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:30.948258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:31.003306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:31.011953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7fd7ab98-76fd-4cca-9b0d-3f369f4789e7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.169436 Sep 13 16:29:31.012981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1577/3161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:30 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:31.022273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:31.030666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c90c7669-b193-4ce2-825e-9a720685eb81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.096836 Sep 13 16:29:31.031269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1585/3162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:31.346448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:31.347095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:31.354039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:31.354531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:31.354991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:31.355691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:31.356147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:31.356573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:31.490606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:31.498762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ffd88c55-695c-4916-9d1e-e55630769b48 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.156127 Sep 13 16:29:31.499350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1578/3163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:31 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:32.036139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:32.036689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:32.043576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:32.044037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:32.044470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:32.045191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:32.045638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:32.046056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:32.054116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:32.054756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:32.061331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:32.061824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:32.062283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:32.062998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:32.063480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:32.063865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:32.140889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:32.149839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2fe214a9-d649-4636-83ef-c11f1925a384 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.100172 Sep 13 16:29:32.150409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1579/3164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:32.201571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:32.210388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c2e04f1-b216-4268-8129-947336be525c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.178181 Sep 13 16:29:32.210970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1586/3165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:32 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:32.522273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:32.522918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:32.528943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:32.529415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:32.529854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:32.530544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:32.531031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:32.531464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:32.657596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:32.665993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eacc829b-858a-4149-a1b2-d4a780f82e4c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148353 Sep 13 16:29:32.666553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1580/3166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:32 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:33.173944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:33.174587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:33.181643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:33.182122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:33.182560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:33.183277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:33.183727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:33.184153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:33.239268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:33.240565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:33.247161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:33.247715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:33.248157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:33.248846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:33.249294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:33.249718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:33.254459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:33.263340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-02cde66e-eb0a-4fe1-b24f-494b98073f4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.093012 Sep 13 16:29:33.264236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1587/3167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:33.387694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:33.395826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26e1cc63-6800-419b-b370-2aeec4e00a8d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.160316 Sep 13 16:29:33.396453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1581/3168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:33 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:33.689523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:33.690268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:33.696243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:33.696783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:33.697223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:33.697912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:33.698363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:33.698787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:33.825709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:33.834449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e3018bb-59c3-4177-83f2-c9850e37397c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148106 Sep 13 16:29:33.835157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1588/3169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:33 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:34.286449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:34.287353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:34.293670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:34.294145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:34.294574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:34.295284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:34.295733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:34.296150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:34.357553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:34.366387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-69e0b058-984c-4f14-b931-2d3d515b7659 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083847 Sep 13 16:29:34.366971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1582/3170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:34.419864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:34.420470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:34.426831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:34.428023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:34.428471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:34.429150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:34.429601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:34.430025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:34.559077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:34.567127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbb78222-f9f4-4cd3-9bda-ee9db3eaa536 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.150994 Sep 13 16:29:34.567689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1589/3171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:34 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:34.857817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:34.858441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:34.864289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:34.864785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:34.866070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:34.866840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:34.867316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:34.867740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:34.996445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:35.004537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72f8fe29-72ad-42da-81ed-0c35e8c68d81 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150598 Sep 13 16:29:35.005106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1583/3172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:34 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:35.389633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:35.390249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:35.396796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:35.397281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:35.397725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:35.398418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:35.398875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:35.399333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:35.460286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:35.468340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9bbe7db-2ae3-4866-82d5-d27b19de99db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082633 Sep 13 16:29:35.468902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1590/3173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:35.590847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:35.591469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:35.597778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:35.598257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:35.598691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:35.599473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:35.599917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:35.600335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:35.729824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:35.738107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04abd110-a407-4d08-bf81-1103926c8d12 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.151088 Sep 13 16:29:35.738673 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1584/3174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:36.027585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:36.028117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:36.034007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:36.034477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:36.034926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:36.035603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:36.036053 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:36.036472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:36.163059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:36.171183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad23c43a-b896-47b3-806a-522b2bf136f3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147391 Sep 13 16:29:36.171738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1591/3175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:36 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:36.491201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:36.491808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:36.497747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:36.498229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:36.498670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:36.499386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:36.499839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:36.500266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:36.560228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:36.568551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5bb68d1-773f-45f0-a8fe-81b5ffeb6549 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081319 Sep 13 16:29:36.569106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1585/3176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:36.761826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:36.762369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:36.768816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:36.769299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:36.769738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:36.770423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:36.770876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:36.772052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:36.903334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:36.905520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:36.912887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc97c394-7726-4f38-93ae-575d1b5583f7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.154957 Sep 13 16:29:36.913449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1592/3177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:37.195925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:37.196565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:37.203173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:37.203653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:37.204086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:37.204769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:37.205214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:37.205642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:37.331426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:37.339554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be37b727-8eb9-488f-8c25-198a1a05b3c1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148397 Sep 13 16:29:37.340112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1586/3178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:37 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:37.592284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:37.592823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:37.598727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:37.599902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:37.600487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:37.601174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:37.601625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:37.602058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:37.666167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:37.674291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6072bf58-fc35-4798-bef5-2aa67e65061a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085947 Sep 13 16:29:37.674863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1593/3179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:37.935774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:37.936319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:37.942175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:37.942656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:37.943294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:37.944056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:37.944505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:37.944932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:38.071030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:38.079355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-656ffc4a-01d9-4403-954f-6be547abbd5f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1726 microversion: 2.1 time: 0.147719 Sep 13 16:29:38.079912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1587/3180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:37 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:38.103768 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-788508eb-f79c-474e-9b0e-336e1edda368 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '.version_select at 0x7fb67c6a1820>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:38.123084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-788508eb-f79c-474e-9b0e-336e1edda368 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392203280" status: 202 len: 0 microversion: 2.1 time: 0.023845 Sep 13 16:29:38.123680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1594/3181] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Sep 13 16:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392203280 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:29:38.362781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:38.363430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:38.369922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:38.370403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:38.370846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:38.371572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:38.372026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:38.372452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:38.699267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:38.699892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:38.707054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:38.707547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:38.707988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:38.708873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:38.709336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:38.709766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:38.793232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:38.801447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1391ffde-8149-440a-8178-d36a703b0d6a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.106539 Sep 13 16:29:38.802022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1595/3182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:38.837229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:38.851424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f469e5b-30e6-43c5-a630-c3296ab1f27a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.492461 Sep 13 16:29:38.852309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1588/3183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:38 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:39.351771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-d8e25afc-1282-4abf-871d-aca3c8bbb5b5 req-77232376-4f1c-4b36-9f35-d260e2f09f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd", "tag": "8fcbe249-d838-4fbc-aa36-0e83ddfe0aab"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:39.361072 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d8e25afc-1282-4abf-871d-aca3c8bbb5b5 req-77232376-4f1c-4b36-9f35-d260e2f09f2b service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.361538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d8e25afc-1282-4abf-871d-aca3c8bbb5b5 req-77232376-4f1c-4b36-9f35-d260e2f09f2b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.362063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d8e25afc-1282-4abf-871d-aca3c8bbb5b5 req-77232376-4f1c-4b36-9f35-d260e2f09f2b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.374234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-d8e25afc-1282-4abf-871d-aca3c8bbb5b5 req-77232376-4f1c-4b36-9f35-d260e2f09f2b service nova] Creating event network-changed:8fcbe249-d838-4fbc-aa36-0e83ddfe0aab for instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd on hv-cinder-82002 Sep 13 16:29:39.380669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-d8e25afc-1282-4abf-871d-aca3c8bbb5b5 req-77232376-4f1c-4b36-9f35-d260e2f09f2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Sep 13 16:29:39.381646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1596/3184] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:39.565664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-655e66b7-3834-4c4d-879a-5c471ade0a02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: .version_select at 0x7fb67fa16c10>, body: {"keypair": {"name": "tempest-keypair-89224440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZmvNX+OAsmTJy6dxWq2yGZgRu9wOUCJbjQBXHaEgRPsSIhXZfUkoAhO1fItUgR1SmfO1C6z6hh6KSLTWKZmTFpY7LRMgWBjGkeeyKeXpC+LNPgZYWXxtSfQjeShj4jaA=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:39.585537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-655e66b7-3834-4c4d-879a-5c471ade0a02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:29:39.590192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-655e66b7-3834-4c4d-879a-5c471ade0a02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:29:39.602415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:39.617550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-655e66b7-3834-4c4d-879a-5c471ade0a02 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056506 Sep 13 16:29:39.618461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1589/3185] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:29:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:39.827285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:39.827996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:39.835451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.836177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.836829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.837722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.838341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.839101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.875383 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:39.876318 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:39.883298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.883780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.884403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.885307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.885758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.886187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.947202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:39.957164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1bcd76e2-c341-4487-b868-f972028aad33 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.134448 Sep 13 16:29:39.958019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1597/3186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:40.113266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:40.125746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd23dc60-3a73-4988-af83-b81a3d4721bd tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.254286 Sep 13 16:29:40.126929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1590/3187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:39 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:40.981484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:40.982101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:40.988667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:40.989155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:40.989767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:40.990878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:40.991367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:40.991800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:41.060782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1334325111", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90fe5e9a-9ff6-4724-a98f-1f72ad00105b"}], "security_groups": [{"name": "tempest-securitygroup--1288421039"}], "key_name": "tempest-keypair-89224440", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:41.062200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:41.070810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-602c0c54-8d8b-483c-ace6-6b3d12fd3896 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.093236 Sep 13 16:29:41.071424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1598/3188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:41.150723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:41.151365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:41.157349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:41.157773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:41.158210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:41.158918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:41.159382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:41.159814 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:41.170144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] validate_networks() for [('90fe5e9a-9ff6-4724-a98f-1f72ad00105b', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:29:41.363028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:41.372089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4591171c-f820-4e98-9fe1-510c87e342e3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.226232 Sep 13 16:29:41.383429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1599/3189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:41 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:41.605697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:29:41.606124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:29:41.606631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:29:41.607091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:29:41.607508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:29:41.616342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:41.616821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:41.617255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:41.617975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:41.618427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:41.618855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:41.635573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:29:41.639572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:29:41.650946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:29:41.653178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:29:41.698242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d3df8f7-3958-4038-b745-1b068c0dc914 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.641660 Sep 13 16:29:41.698815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1591/3190] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:29:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:29:41.710801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-203d42ab-bd0f-4129-bdb0-ce57bdf5e627 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:41.711457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-203d42ab-bd0f-4129-bdb0-ce57bdf5e627 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:41.766166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-203d42ab-bd0f-4129-bdb0-ce57bdf5e627 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:41.773428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-203d42ab-bd0f-4129-bdb0-ce57bdf5e627 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1240 microversion: 2.1 time: 0.067230 Sep 13 16:29:41.773998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1600/3191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:41 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:42.094654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:42.095333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:42.102623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:42.103141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:42.103584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:42.104271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:42.104732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:42.105156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:42.170690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:42.180777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29b4aea0-6edb-4a61-9934-26e71f88571a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.090573 Sep 13 16:29:42.181347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1592/3192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:42.395353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:42.396099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:42.402491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:42.403001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:42.403431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:42.404114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:42.404558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:42.404978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:42.539636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:42.547973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffd40602-321f-41b9-a2c2-d1f467376d8f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.156440 Sep 13 16:29:42.548662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1601/3193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:42 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:42.796210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:42.796785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:42.802729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:42.803294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:42.803730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:42.804413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:42.804889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:42.805314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:42.867413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:42.875497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15920c9f-8b4b-4a6c-9a2b-5edc4ebc77c7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1292 microversion: 2.1 time: 0.083157 Sep 13 16:29:42.876061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1593/3194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:42 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:43.204025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:43.204637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:43.211554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:43.212039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:43.212478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:43.213190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:43.213644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:43.214071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:43.292065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:43.300581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b95e96d0-7327-4c2d-9406-1c7b62d3f7be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.100384 Sep 13 16:29:43.301154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1602/3195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:43.571199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:43.571817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:43.578539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:43.579061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:43.579505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:43.580211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:43.580686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:43.581112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:43.596877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:43.790761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:43.799320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-adc49280-94e7-4b27-8cfc-5805f485a893 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.232594 Sep 13 16:29:43.799895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1594/3196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:43 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:43.902370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:43.903038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:43.911748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:43.912244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:43.913027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:43.914188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:43.914862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:43.915585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:44.133097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:44.140900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3a536b1-41cb-4b53-ba23-71d4f9cd0677 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1366 microversion: 2.1 time: 0.242435 Sep 13 16:29:44.141482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1603/3197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:43 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:44.325353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:44.326004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:44.332781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:44.333301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:44.333764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:44.334491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:44.334961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:44.335384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:44.572347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:44.581368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a45b8796-7d60-4ac5-be04-29652b66ff81 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.260226 Sep 13 16:29:44.581958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1595/3198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:44.766193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3833e2b7-3f28-4b0f-a7a9-e48eb801cca4 req-d2651ca8-b51b-4fe5-89e6-e2fe873659d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef222483-435a-484e-a2b3-74b22b9f281c", "tag": "cf43def3-5087-4867-a08c-c61768216779"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:44.772080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:44.778752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3833e2b7-3f28-4b0f-a7a9-e48eb801cca4 req-d2651ca8-b51b-4fe5-89e6-e2fe873659d1 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:44.779549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3833e2b7-3f28-4b0f-a7a9-e48eb801cca4 req-d2651ca8-b51b-4fe5-89e6-e2fe873659d1 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:44.779983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3833e2b7-3f28-4b0f-a7a9-e48eb801cca4 req-d2651ca8-b51b-4fe5-89e6-e2fe873659d1 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:44.792004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3833e2b7-3f28-4b0f-a7a9-e48eb801cca4 req-d2651ca8-b51b-4fe5-89e6-e2fe873659d1 service nova] Creating event network-changed:cf43def3-5087-4867-a08c-c61768216779 for instance ef222483-435a-484e-a2b3-74b22b9f281c on hv-cinder-82002 Sep 13 16:29:44.796796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3833e2b7-3f28-4b0f-a7a9-e48eb801cca4 req-d2651ca8-b51b-4fe5-89e6-e2fe873659d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Sep 13 16:29:44.797392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1604/3199] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:44.821681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:44.822299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:44.828549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:44.829044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:44.829488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:44.830185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:44.830644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:44.831112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:45.061191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:45.070541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3abe631-be09-4078-82c8-b573d49784b1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.252816 Sep 13 16:29:45.071088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1596/3200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:44 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:45.165853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:45.166638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:45.172811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:45.173293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:45.173732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:45.174418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:45.174870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:45.175321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:45.341775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:45.350179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ec76de7-aade-481e-bc05-8d0f6d681ce7 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1366 microversion: 2.1 time: 0.189570 Sep 13 16:29:45.350969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1605/3201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:45 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:45.604761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:45.605373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:45.611763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:45.612240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:45.612675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:45.613354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:45.613806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:45.614225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:45.678976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:45.687205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35568985-2465-40db-97d9-57178ba4c765 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086139 Sep 13 16:29:45.687763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1597/3202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:46.093406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:46.094014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:46.100228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:46.100699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:46.101133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:46.101805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:46.102250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:46.102668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:46.228836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:46.236930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5fa3cbd-63fa-4497-81a8-c4fdba731019 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147318 Sep 13 16:29:46.237502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1606/3203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:46 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:46.373663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:46.374216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:46.380736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:46.381370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:46.381820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:46.382554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:46.383042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:46.383475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:46.578619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:46.586563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f0661c9-b673-4c7b-9830-d0f77bc6abe3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1366 microversion: 2.1 time: 0.216877 Sep 13 16:29:46.587254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1598/3204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:46 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:46.709894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:46.710594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:46.716521 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:46.717000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:46.717435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:46.718112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:46.718556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:46.718996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:46.789764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:46.797861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e419e13-b550-4e97-90fb-821dc039f944 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.092082 Sep 13 16:29:46.798425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1607/3205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:47.260553 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:47.261312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:47.267566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:47.268042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:47.268474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:47.269157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:47.269605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:47.270027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:47.398891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:47.407089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78c9e638-ac00-4c24-9705-388f5427f52d tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150396 Sep 13 16:29:47.407646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1599/3206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:47 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:47.609614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:47.610154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:47.616601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:47.617082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:47.617520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:47.618208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:47.618660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:47.619121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:47.750850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:47.759635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6980ebc3-5b12-4a82-887b-a28bf03feebf tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1366 microversion: 2.1 time: 0.153917 Sep 13 16:29:47.760211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1608/3207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:47 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:47.824565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:47.825251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:47.831734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:47.832211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:47.832641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:47.834035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:47.834512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:47.834937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:47.897566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:47.905618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2775c14-f457-4187-ada4-e826883513ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087903 Sep 13 16:29:47.906171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1600/3208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:48.430182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:48.430800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:48.436866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:48.437351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:48.437794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:48.438481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:48.438959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:48.439390 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:48.565141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:48.573563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-980896bc-0645-423e-9628-7dcceacc6eb6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.147911 Sep 13 16:29:48.574393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1609/3209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:48 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:48.782826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:48.783406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:48.791067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:48.791551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:48.791993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:48.792686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:48.793142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:48.793572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:48.924639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:48.928970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:48.929586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:48.932591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d6c0f61-9173-4359-bf21-fd1c4ae7d5c2 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1366 microversion: 2.1 time: 0.153747 Sep 13 16:29:48.933167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1601/3210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:48 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:48.936064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:48.936543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:48.937001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:48.937673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:48.938126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:48.938553 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:49.000400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:49.009281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08d96c5d-72ef-48cf-b458-910ff64d7b8e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084152 Sep 13 16:29:49.009856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1610/3211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:49.598599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:49.600110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:49.606099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:49.606578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:49.607040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:49.607731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:49.608183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:49.608607 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:49.739081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:49.748483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11db370c-5c20-42fb-ad79-807db0def6cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.154809 Sep 13 16:29:49.749081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1602/3212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:49 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:49.756312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c415436c-5fce-4ab8-83cf-fe1aa82a2ffe req-94588d52-e539-42eb-b057-8438a2897434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef222483-435a-484e-a2b3-74b22b9f281c", "name": "network-vif-plugged", "status": "completed", "tag": "cf43def3-5087-4867-a08c-c61768216779"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:49.765833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c415436c-5fce-4ab8-83cf-fe1aa82a2ffe req-94588d52-e539-42eb-b057-8438a2897434 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:49.766386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c415436c-5fce-4ab8-83cf-fe1aa82a2ffe req-94588d52-e539-42eb-b057-8438a2897434 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:49.766848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c415436c-5fce-4ab8-83cf-fe1aa82a2ffe req-94588d52-e539-42eb-b057-8438a2897434 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:49.779634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c415436c-5fce-4ab8-83cf-fe1aa82a2ffe req-94588d52-e539-42eb-b057-8438a2897434 service nova] Creating event network-vif-plugged:cf43def3-5087-4867-a08c-c61768216779 for instance ef222483-435a-484e-a2b3-74b22b9f281c on hv-cinder-82002 Sep 13 16:29:49.784765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c415436c-5fce-4ab8-83cf-fe1aa82a2ffe req-94588d52-e539-42eb-b057-8438a2897434 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Sep 13 16:29:49.785349 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1611/3213] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:49.955951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:49.957007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:49.963986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:49.964507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:49.964917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:49.965603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:49.966047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:49.966499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:50.032850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:50.033535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:50.040840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:50.041328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:50.041762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:50.042451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:50.042924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:50.043347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:50.114856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:50.122108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:50.123237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5734a4a2-f751-46a9-808a-033589fbd37f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.094463 Sep 13 16:29:50.123866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1612/3214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:50.129904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-884a9600-2fdc-4833-afc4-eea2a9e42b52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1366 microversion: 2.1 time: 0.177831 Sep 13 16:29:50.130585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1603/3215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:49 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:50.772859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:50.773462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:50.779359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:50.779832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:50.780263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:50.780939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:50.781383 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:50.781801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:50.796142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:50.916360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:50.924446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb723804-b60f-42e0-bf2b-3155cb19c16b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.155723 Sep 13 16:29:50.924999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1613/3216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:50 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:51.147039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:51.148014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:51.154876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.155227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:51.155848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:51.156211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.156644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.157412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.157778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.158197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.164891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.165730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.167697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.167856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.169268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.169710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.227428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:51.235641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4199875-15a3-48e9-b85d-dcb1de226e95 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.092699 Sep 13 16:29:51.236207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1604/3217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:51.319293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:51.327168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8effc1e2-e36d-471e-aade-ec8c3bed0b7f tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1557 microversion: 2.1 time: 0.178224 Sep 13 16:29:51.327742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1614/3218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:51 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:51.350170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:51.350671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:51.356880 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.357365 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.357804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.358495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.358978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.359406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.438857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b68ba33a-54d5-4199-b688-89abf4ccae29 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093037 Sep 13 16:29:51.439496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1605/3219] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:29:51 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:51.948225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:51.948761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:51.950914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:51.956199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.956688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.957127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:51.957818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:51.958859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:51.959357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:52.184356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:52.193140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd15092b-17e4-44e1-8bc1-fc13da1fb93c tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.248212 Sep 13 16:29:52.194329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1615/3220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:51 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:52.256686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:52.257408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:52.261813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:52.262425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:52.269501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:52.269980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:52.270418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:52.271179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:52.271633 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:52.272057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:52.368197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:52.380203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc0187f5-7805-4ac3-bd70-2a695aa8de77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.125007 Sep 13 16:29:52.381021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1606/3221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:52.466770 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4b4c3eca-6767-4c18-aa0c-bebae8d6b818 req-c3f0e2c0-1910-4a70-92f0-fb724bcec485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef222483-435a-484e-a2b3-74b22b9f281c", "tag": "cf43def3-5087-4867-a08c-c61768216779"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:29:52.476984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4b4c3eca-6767-4c18-aa0c-bebae8d6b818 req-c3f0e2c0-1910-4a70-92f0-fb724bcec485 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:52.477462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4b4c3eca-6767-4c18-aa0c-bebae8d6b818 req-c3f0e2c0-1910-4a70-92f0-fb724bcec485 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:52.477900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4b4c3eca-6767-4c18-aa0c-bebae8d6b818 req-c3f0e2c0-1910-4a70-92f0-fb724bcec485 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:52.489040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4b4c3eca-6767-4c18-aa0c-bebae8d6b818 req-c3f0e2c0-1910-4a70-92f0-fb724bcec485 service nova] Creating event network-changed:cf43def3-5087-4867-a08c-c61768216779 for instance ef222483-435a-484e-a2b3-74b22b9f281c on hv-cinder-82002 Sep 13 16:29:52.494193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4b4c3eca-6767-4c18-aa0c-bebae8d6b818 req-c3f0e2c0-1910-4a70-92f0-fb724bcec485 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031116 Sep 13 16:29:52.495783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1616/3222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:29:53.217360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:53.218008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:53.224154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:53.224643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:53.225087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:53.225784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:53.226233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:53.226647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:53.362180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:53.371286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c17d75a7-73aa-47ea-9572-02d6398f935f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.157717 Sep 13 16:29:53.372122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1607/3223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:53 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:53.403776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:53.404507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:53.410752 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:53.412652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:53.413372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:53.414187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:53.414859 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:53.415382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:53.481057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:53.491220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9c25bc3-67ed-47b4-9d06-2e0c416e2773 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.091479 Sep 13 16:29:53.492102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1617/3224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:54.395142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:54.396322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:54.402623 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:54.403143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:54.403576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:54.404252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:54.404700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:54.405124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:54.513821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:54.514454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:54.521491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:54.521971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:54.522409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:54.523129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:54.523586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:54.524008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:54.536261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:54.544721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8ac54f5-c682-4183-ba70-81c721721ead tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153492 Sep 13 16:29:54.545684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1608/3225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:54 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:54.588557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:54.596669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef7c4b4e-01d1-4228-b9ad-53f32a2c6c30 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086899 Sep 13 16:29:54.597223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1618/3226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:55.569757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:55.570373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:55.577008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:55.577489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:55.577950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:55.578631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:55.579111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:55.579535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:55.618828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:55.619484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:55.626291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:55.626804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:55.627352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:55.628166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:55.628561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:55.628982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:55.905711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:55.914565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3024a8e-c239-4411-85f6-00b71791e50e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.299631 Sep 13 16:29:55.915159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1619/3227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:55.965197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:55.973253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e27f04b5-673c-43f3-b8c7-01cc425021d3 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.407860 Sep 13 16:29:55.973874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1609/3228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:55 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:56.937609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:56.938212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:56.945059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:56.945532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:56.945965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:56.946644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:56.947121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:56.947540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:56.996051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:56.996665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:57.003067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:57.003777 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:57.004218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:57.004910 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:57.005692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:57.005897 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:57.011735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:57.019864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f339799-24f1-4748-a19c-4da2627479c9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086097 Sep 13 16:29:57.020421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1620/3229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:57.133106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:57.141202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af681220-c874-4a70-91aa-ef8055f238b4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148956 Sep 13 16:29:57.141796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1610/3230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:56 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:29:58.045221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:58.045891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:58.055623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:58.056101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:58.056538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:58.057224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:58.057707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:58.058127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:58.128160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:58.137202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f4b2e5b-4182-4a74-ba4c-bf2db758fc72 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.097189 Sep 13 16:29:58.137786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1621/3231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:58.164987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:58.165581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:58.172691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:58.173181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:58.173598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:58.174402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:58.174853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:58.175336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:58.196458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:58.326773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:58.335972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16f0f5b2-1649-4a1d-a4bf-5aa32405d478 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.175044 Sep 13 16:29:58.336540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1611/3232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:58 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:59.163533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:59.164144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:59.170705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:59.171224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:59.171670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:59.172352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:59.172836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:59.173283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:59.233388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:59.242208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8aab7eb-b545-4b07-b5d0-4df37ca01335 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082713 Sep 13 16:29:59.242811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1622/3233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:29:59.353464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:59.354026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:59.360104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:59.360525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:29:59.360663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:59.361014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:59.361248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:29:59.361708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:59.362171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:59.362597 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:59.368204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:59.368685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:59.369123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:59.369811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:59.370265 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:59.370687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:59.386734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd7e24c3-dba8-4646-8098-5cb821c4719c tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6/ips" status: 200 len: 151 microversion: 2.20 time: 0.037806 Sep 13 16:29:59.387341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1612/3234] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Sep 13 16:29:59 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:29:59.497084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:29:59.505221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84a2b3e1-501b-4d2a-b13d-602dd3370306 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148381 Sep 13 16:29:59.505894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1623/3235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:29:59 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:00.265650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:00.266256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:00.272951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:00.273423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:00.273852 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:00.274530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:00.275010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:00.275460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:00.338302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:00.346409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df7ce136-14aa-4d73-988d-59e366efde28 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084640 Sep 13 16:30:00.346977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1613/3236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:00.529179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:00.529793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:00.536411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:00.536894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:00.537332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:00.538045 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:00.538499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:00.538951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:00.663784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:00.671912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ead7ef29-8780-4f94-9f06-f736a3850367 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146604 Sep 13 16:30:00.672478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1624/3237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:00 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:01.369539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:01.370145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:01.376456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:01.376931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:01.377360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:01.378037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:01.378484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:01.378921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:01.440928 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:01.449261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de043da9-f49f-4861-9391-646888bcc317 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083567 Sep 13 16:30:01.450079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1614/3238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:01.695964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:01.696512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:01.703116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:01.703594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:01.704025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:01.704696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:01.705150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:01.705569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:01.834928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:01.843021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-780fc5c6-1535-48c3-8d1e-6e8ed66799e6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.151492 Sep 13 16:30:01.843585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1625/3239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:01 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:02.472963 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:02.474078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:02.480533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:02.481009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:02.481446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:02.482126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:02.482578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:02.483034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:02.544119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:02.553130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e167d6c-ee47-4f31-a987-75f5c54d38fa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083974 Sep 13 16:30:02.553699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1615/3240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:02.865529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:02.866159 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:02.872714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:02.873194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:02.873629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:02.874311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:02.874761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:02.875235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:03.006106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:03.014480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a4533b8-12b4-4b75-b1b4-ba8f96a7a060 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.152808 Sep 13 16:30:03.015078 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1626/3241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:02 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:03.577406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:03.578032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:03.584737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:03.585239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:03.585680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:03.586394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:03.586845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:03.587310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:03.653100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:03.661190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05e1625f-6af3-439c-a3f4-07cf07d05dce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087917 Sep 13 16:30:03.661905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1616/3242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:04.038142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:04.038681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:04.045157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:04.045642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:04.046077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:04.046764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:04.047246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:04.047669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:04.174098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:04.182883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0893a745-5cfa-4d5a-8448-090c6e3ab26f tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.149296 Sep 13 16:30:04.183456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1627/3243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:04 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:04.684802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:04.685409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:04.691757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:04.692231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:04.692665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:04.693986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:04.694440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:04.694860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:04.754535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:04.763332 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bad6ff8-b81f-412f-8a52-1b23514f5b9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082375 Sep 13 16:30:04.763887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1617/3244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:05.206188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:05.206820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:05.213873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:05.214348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:05.214779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:05.215487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:05.215933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:05.216354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:05.346820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:05.356105 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f791fdde-e580-46e4-bdfb-3eed14e120f7 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153779 Sep 13 16:30:05.356667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1628/3245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:05 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:05.787693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:05.788246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:05.794594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:05.795104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:05.795539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:05.796218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:05.796665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:05.797083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:05.858021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:05.866162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96b0bded-e8eb-46ad-96ce-dbf6618f7005 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083031 Sep 13 16:30:05.866717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1618/3246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:06.380147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:06.381387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:06.388413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:06.388890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:06.389327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:06.390036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:06.390487 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:06.390930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:06.521560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:06.530097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2501f884-fea6-4dc6-bba6-f06710eee97a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153779 Sep 13 16:30:06.530653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1629/3247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:06 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:06.889421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:06.890151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:06.896334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:06.896838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:06.897321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:06.898007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:06.898453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:06.898869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:06.962465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:06.970748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90c8a42b-6a02-444b-abdb-a7e02fc40347 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085235 Sep 13 16:30:06.971334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1619/3248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:07.553151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:07.553767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:07.560143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:07.560628 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:07.561067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:07.561750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:07.562203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:07.562627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:07.687696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:07.689977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:07.697914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7dc79935-519b-47cc-bf61-035f3d79ed98 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.148777 Sep 13 16:30:07.698519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1630/3249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:07 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:07.994180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:07.994752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:08.001112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:08.001591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:08.002033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:08.002714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:08.003209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:08.003631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:08.066701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:08.075987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70c72711-bd00-425d-85a4-dccb42ebdd70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086278 Sep 13 16:30:08.076542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1620/3250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:08.721168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:08.721801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:08.729295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:08.729769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:08.730198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:08.730872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:08.731340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:08.731759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:08.861389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:08.874362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f1548c6-a5af-4e98-bb87-97f6692ec29e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.153243 Sep 13 16:30:08.875034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1631/3251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:08 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:09.098966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:09.099776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:09.106124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:09.106601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:09.107066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:09.107748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:09.108191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:09.108609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:09.168838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:09.176902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06902891-c2fb-4c97-bd8e-2ec94a045eb5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081785 Sep 13 16:30:09.177474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1621/3252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:09.900070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:09.900686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:09.906639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:09.907147 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:09.907584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:09.908260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:09.908709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:09.909131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:10.033745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:10.042448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e12f640-f28e-4161-b387-894c0ec97174 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.146544 Sep 13 16:30:10.043043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1632/3253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:09 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:10.198656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:10.199239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:10.201767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:10.207203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:10.207677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:10.208107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:10.209388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:10.210205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:10.210617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:10.275691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:10.283993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-acd4d224-26bd-4ece-bfad-e462f90e3ece tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089237 Sep 13 16:30:10.284533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1622/3254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:11.068232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:11.070352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:11.075778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:11.076257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:11.076692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:11.077373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:11.077822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:11.078242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:11.206172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:11.214759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c8a7a4a-28c7-44ec-97ae-6d2c5fe265a1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150392 Sep 13 16:30:11.215353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1633/3255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:11 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:11.307562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:11.308199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:11.314686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:11.315150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:11.315584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:11.316266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:11.316712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:11.317133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:11.380313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:11.389945 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2731b2da-a28c-4643-8961-91caaaf4aa1b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086148 Sep 13 16:30:11.390531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1623/3256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:12.238348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:12.238973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:12.246052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:12.246535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:12.246989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:12.247688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:12.248116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:12.248541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:12.376173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:12.385081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f66641d8-2e3d-4a14-a29b-5eb963b78a1e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f" status: 200 len: 1733 microversion: 2.1 time: 0.150520 Sep 13 16:30:12.385645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1634/3257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:12 2022] GET /compute/v2.1/servers/7a8e8d08-fc78-4837-8f60-1ba9a1855c8f => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:12.407711 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2f63e3a-bf60-4fe0-9282-508490c957e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '.version_select at 0x7fb67c180040>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:12.413397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:12.414087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:12.420000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:12.420548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:12.421081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:12.421812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:12.422249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:12.422666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:12.426619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2f63e3a-bf60-4fe0-9282-508490c957e4 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227990365" status: 202 len: 0 microversion: 2.1 time: 0.022684 Sep 13 16:30:12.427300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1624/3258] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Sep 13 16:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227990365 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:12.497593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:12.507208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eeb46101-0819-4f59-9999-f0e9af963442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.097326 Sep 13 16:30:12.507596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1635/3259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:13.312105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-9ef4ffa8-92d8-4706-ad92-0774c4f18caf req-293b0ed7-4705-4cc6-a7a8-9df483c87964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:13.323210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9ef4ffa8-92d8-4706-ad92-0774c4f18caf req-293b0ed7-4705-4cc6-a7a8-9df483c87964 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:13.323687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9ef4ffa8-92d8-4706-ad92-0774c4f18caf req-293b0ed7-4705-4cc6-a7a8-9df483c87964 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:13.324114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9ef4ffa8-92d8-4706-ad92-0774c4f18caf req-293b0ed7-4705-4cc6-a7a8-9df483c87964 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:13.335323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-9ef4ffa8-92d8-4706-ad92-0774c4f18caf req-293b0ed7-4705-4cc6-a7a8-9df483c87964 service nova] Creating event network-changed:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:30:13.340361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-9ef4ffa8-92d8-4706-ad92-0774c4f18caf req-293b0ed7-4705-4cc6-a7a8-9df483c87964 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032216 Sep 13 16:30:13.340944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1625/3260] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:13.530661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:13.532242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:13.540944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:13.541548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:13.542233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:13.543244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:13.543771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:13.544286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:13.623530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:13.633237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc571794-2465-4bbc-ae18-e30799605dfb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.107345 Sep 13 16:30:13.634126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1636/3261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:14.657217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:14.657845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:14.664056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:14.664535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:14.664972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:14.665656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:14.666104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:14.666525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:14.728513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:14.736644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a31a4f57-727d-418f-8cf7-cda98242897b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084230 Sep 13 16:30:14.737201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1626/3262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:15.760347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:15.760864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:15.763448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=66 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:15.768889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:15.769395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:15.769851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:15.770532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:15.771578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:15.772108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:15.836492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:15.844583 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-360a8bd9-0aad-48bc-beb9-5bcf322b5b4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088241 Sep 13 16:30:15.845140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1637/3263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:16.867785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:16.868397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:16.874724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:16.875245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:16.875694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:16.876368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:16.876814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:16.877239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:16.940155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:16.948497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a19a6889-723a-487c-9f86-8c641bd65521 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085357 Sep 13 16:30:16.949055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1627/3264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:17.971973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:17.972600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:17.979011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:17.979492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:17.979930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:17.980613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:17.981066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:17.981490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:18.042541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:18.050791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64a7fad9-9746-4657-8b89-692c15d9f7ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082687 Sep 13 16:30:18.051369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1638/3265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:19.074423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:19.075315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:19.081642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:19.082122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:19.082559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:19.083277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:19.083732 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:19.084170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:19.148477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:19.156951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba156955-1599-497e-8dfd-d69ebed9b687 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086412 Sep 13 16:30:19.157521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1628/3266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:20.179820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:20.180462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:20.186967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:20.187451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:20.187888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:20.188577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:20.189028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:20.189447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:20.253066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:20.261983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-17cbe745-ba40-4e29-831c-439109bffd3a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086198 Sep 13 16:30:20.262629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1639/3267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:21.285404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:21.286017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:21.292507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:21.292991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:21.293452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:21.294142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:21.294596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:21.295074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:21.355559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:21.363739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8e9b397-3e42-4e9b-b34d-7081f29f4b25 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082204 Sep 13 16:30:21.364295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1629/3268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:22.386424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:22.387753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:22.394547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:22.395067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:22.395506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:22.396192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:22.396645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:22.397324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:22.458446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:22.466887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f50db9c6-e4ab-4c3c-81fa-5efe015a0057 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084353 Sep 13 16:30:22.467476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1640/3269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:23.489828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:23.490451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:23.497115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.497601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.498046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.498740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.499229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.499687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.503704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:23.562018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:23.570857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5746cfb3-6c21-4e46-a760-758244f08144 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084938 Sep 13 16:30:23.571452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1630/3270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:24.593481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:24.594095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:24.600508 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:24.600984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:24.602017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:24.602698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:24.603190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:24.603609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:24.666492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:24.674593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd395779-50c4-42c6-add5-bf77305c40be tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084906 Sep 13 16:30:24.675225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1641/3271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:25.697552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.698120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:25.704943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:25.705428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:25.705867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:25.706557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:25.707060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:25.707488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:25.768276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:25.776584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc6bbebf-4d64-4600-9163-52224fe59b48 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082930 Sep 13 16:30:25.777178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1631/3272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:26.799731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.800350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:26.807254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:26.807738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:26.808177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:26.808871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:26.809326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:26.809757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:26.872282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:26.880479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a751a6e4-9e58-4e75-b8f6-74c6000a5112 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084604 Sep 13 16:30:26.881043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1642/3273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:27.340408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.340967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:27.347262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:27.347736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:27.348164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:27.348839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:27.349413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:27.349839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:27.374319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e8245ad-1361-4376-a8d9-6aa2cbf13e39 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c/ips" status: 200 len: 150 microversion: 2.1 time: 0.037810 Sep 13 16:30:27.374866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1632/3274] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:30:27 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:27.904295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.904877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:27.911218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:27.911694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:27.912122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:27.912826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:27.913272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:27.913709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:27.974872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:27.983121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49717e5a-dc69-4522-a2a6-104ff0433031 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082620 Sep 13 16:30:27.983681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1643/3275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:29.005839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.006456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:29.013186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:29.013675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:29.014161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:29.014860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:29.015343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:29.015770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:29.080108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:29.088762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c367997-48e3-42a2-bdf6-f5d88d413585 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086789 Sep 13 16:30:29.089324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1633/3276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:30.112456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.113069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:30.119908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:30.120389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:30.120831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:30.121517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:30.121968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:30.122395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:30.182615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:30.190860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85cdf5af-06f7-4a8f-8b31-753f74297537 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082286 Sep 13 16:30:30.191444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1644/3277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:31.215831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.216444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:31.223005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:31.223497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:31.223974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:31.224675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:31.225167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:31.225599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:31.290761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:31.299034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee69afbb-2c13-463f-b4df-10f06fea4f4a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087016 Sep 13 16:30:31.299599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1634/3278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:32.321607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:32.322127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:32.328918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:32.329395 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:32.329825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:32.330499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:32.330979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:32.331402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:32.392520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:32.401226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8dde2e02-b758-43cf-8aab-a7c34ac8238e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083525 Sep 13 16:30:32.401801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1645/3279] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:33.425033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:33.425641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:33.432354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:33.432843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:33.433273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:33.433975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:33.434430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:33.434856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:33.503960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:33.512448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-345fe0e3-ae0d-4e21-a8cf-710e800759b8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.091240 Sep 13 16:30:33.513108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1635/3280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:34.536289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:34.537049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:34.544502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.545028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.545465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.546167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.546620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.547092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.611575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:34.620535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64353c0a-b735-43ac-b8b0-b2d532be553b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088184 Sep 13 16:30:34.621100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1646/3281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:35.644788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:35.645386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:35.653096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:35.653505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:35.653939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:35.654625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:35.655141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:35.655559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:35.718642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:35.727618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66d27ad2-08a5-42e0-85e6-7e6bfe21b52b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086623 Sep 13 16:30:35.728179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1636/3282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:36.750827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:36.751515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:36.759001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:36.759781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:36.760382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:36.761205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:36.761666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:36.762091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:36.777505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:36.825530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:36.833875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb559430-30fb-42a1-9f87-0696769293cd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086915 Sep 13 16:30:36.834689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1647/3283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:37.856987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:37.857655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:37.864047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.864531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.864968 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.865654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.866101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.867052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.933982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:37.942467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33c25a57-1999-4c2f-b38f-247ac8fb3e55 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089371 Sep 13 16:30:37.943292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1637/3284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:38.966699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:38.968837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:38.978426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:38.979292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:38.979874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:38.980701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:38.981263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:38.981754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:39.051303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:39.065499 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f335962-2100-47e2-83ad-3c4765fd83f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.103275 Sep 13 16:30:39.066085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1648/3285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:40.089126 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:40.089742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:40.096094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.096580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.097017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.097700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.098155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.098584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.160287 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:40.168868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f80e0377-407b-49ea-9cda-c884ff2ebb53 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083695 Sep 13 16:30:40.169425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1638/3286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:41.191496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.192049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:41.198913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.199400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.200090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.200766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.201241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.201660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.262344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:41.270446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-477ff981-e777-4061-a4cc-f1b448ce86a9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082938 Sep 13 16:30:41.271028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1649/3287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:42.293344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:42.293957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:42.296295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:42.301990 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:42.302473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:42.302932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:42.303646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:42.304193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:42.304617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:42.367818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:42.375828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52f05023-5384-45ef-82df-437a4469428b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086346 Sep 13 16:30:42.376359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1639/3288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:43.399252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:43.399876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:43.406253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:43.406736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:43.407204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:43.407894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:43.408350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:43.408802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:43.470032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:43.479096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba2b371f-c0e5-4ba8-a075-8a918a277b52 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083750 Sep 13 16:30:43.479662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1650/3289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:44.503065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:44.503684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:44.511398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:44.511874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:44.512303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:44.512984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:44.513425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:44.513843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:44.575644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:44.583663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50694a8a-2ad1-491d-9f65-c96e9829a319 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084482 Sep 13 16:30:44.584268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1640/3290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:45.607231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:45.607819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:45.614189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:45.614662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:45.615123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:45.615801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:45.616243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:45.616669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:45.676774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:45.684839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b388b5f0-083e-420a-8406-0ac28912e3ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082158 Sep 13 16:30:45.685398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1651/3291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:46.708854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:46.709400 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:46.716342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:46.716832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:46.717276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:46.717966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:46.718423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:46.718857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:46.783603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:46.791959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ea5b7df-4b1d-48a0-ac75-791e8b5928c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087130 Sep 13 16:30:46.792517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1641/3292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:47.815407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:47.816031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:47.818230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:47.824236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:47.824718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:47.825411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:47.826103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:47.826629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:47.827097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:47.887560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:47.895734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0dc896d5-d2c7-41d7-bd5e-e653652f9e6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084226 Sep 13 16:30:47.896293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1652/3293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:48.918328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.919072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:48.925455 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.925929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.926360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.927072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.927518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.927935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.988564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:48.996959 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85091271-ddaa-4986-b767-111a17063334 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082801 Sep 13 16:30:48.997520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1642/3294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:50.020123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:50.020735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:50.028114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:50.028594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:50.029022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:50.029708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:50.030156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:50.030579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:50.091437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:50.099480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0277cee2-d614-4ebc-98e8-c90ac3257a04 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083213 Sep 13 16:30:50.100038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1653/3295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:51.123208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:51.123814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:51.130317 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:51.130797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:51.131261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:51.131947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:51.132399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:51.132825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:51.195803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:51.204494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55fba839-b249-4917-9a79-02b3eec8f60c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085713 Sep 13 16:30:51.205049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1643/3296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:52.227365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:52.227977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:52.234417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:52.234917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:52.235432 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:52.236114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:52.236564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:52.236992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:52.296987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:52.305133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e2af3c1-d2eb-49fb-9a2f-70d9e7510fb2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081670 Sep 13 16:30:52.305695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1654/3297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:53.328907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:53.329512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:53.336170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:53.336656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:53.337115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:53.337809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:53.338259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:53.338684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:53.398837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:53.406903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f24afd9-4795-4aff-ac2e-317ce76a969b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082432 Sep 13 16:30:53.407960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1644/3298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:54.430223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:54.430842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:54.437926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.438411 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.438850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.439563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.440018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.440446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.503725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:54.512562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d43db90b-1303-4408-a8c0-061cac216cdb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086216 Sep 13 16:30:54.513116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1655/3299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:55.535743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:55.536353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:55.542844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:55.543346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:55.543778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:55.544449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:55.544896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:55.545313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:55.549459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:55.609482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:55.617691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f1835c1-4847-448e-b526-c10d3fc90135 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085800 Sep 13 16:30:55.618248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1645/3300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:56.640931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:56.641606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:56.647465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:56.647946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:56.648380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:56.649058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:56.649509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:56.649935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:56.939682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:56.947821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-551fd792-7a20-4876-992a-edd7e608cb1f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.311913 Sep 13 16:30:56.948434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1656/3301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:57.971408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:57.972024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:57.978419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:57.978924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:57.979368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:57.980499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:57.980951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:57.981374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.041562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:58.050356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4a20343-d630-4e01-ba69-47601566d426 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083121 Sep 13 16:30:58.050916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1646/3302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:59.074338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:59.075240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:59.082017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.082509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.082979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.083690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.084142 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.084568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.150089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:59.162130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09c5b466-55b8-4915-a61c-89b39c5aaf22 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.092251 Sep 13 16:30:59.162763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1657/3303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:00.190200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:00.190818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:00.196794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.197281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.197725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.199006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.199472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.199901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.259782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:00.268730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1e2dd92b-3f75-4a70-9059-e7aafc199e3e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082598 Sep 13 16:31:00.269293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1647/3304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:01.291773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:01.293060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:01.299419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:01.299900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:01.300336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:01.301015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:01.301467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:01.301995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:01.365417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:01.373746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28c57038-01a6-4ffe-8af0-071c354e4a1c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085847 Sep 13 16:31:01.374332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1658/3305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:02.396868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:02.397534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:02.404085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:02.404571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:02.405034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:02.405726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:02.406271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:02.406698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:02.469359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:02.477413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25b6ff50-75c1-44c7-bf6a-93f73d92a2f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084427 Sep 13 16:31:02.477975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1648/3306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:03.501375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:03.501982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:03.508365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.508848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.509282 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.509962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.510500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.511810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.571271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:03.580766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9642868d-158a-49af-8024-6c76623a5953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083188 Sep 13 16:31:03.581329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1659/3307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:04.603492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:04.604113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:04.610474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.610991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.611431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.612119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.612570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.612998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.672642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:04.680678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40245290-a04e-4f7d-9608-912aa3008795 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081050 Sep 13 16:31:04.681234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1649/3308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:05.703863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:05.704409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:05.711016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.711494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.711924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.712603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.713050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.713469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.777896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:05.785946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d53a41a-63a7-4799-a53a-1231a742d222 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086257 Sep 13 16:31:05.786504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1660/3309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:06.810064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:06.810679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:06.817182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:06.817665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:06.818106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:06.818793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:06.819273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:06.819705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:06.880734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:06.888869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1b1ee4b-a9b4-409e-bdaa-8e249ec2bab3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083323 Sep 13 16:31:06.889423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1650/3310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:07.911202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:07.911818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:07.918651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:07.919201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:07.919634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:07.920327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:07.920784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:07.921209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:07.925089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=82 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:07.984180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:07.992277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59fad4cf-5744-42e2-a731-a7ca0c9ed14f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084994 Sep 13 16:31:07.992849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1661/3311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:09.016093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:09.016698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:09.023008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:09.023483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:09.023920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:09.024594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:09.025043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:09.025466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:09.086698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:09.095617 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba007cd5-97e7-4217-8097-b6c7e08f95b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083375 Sep 13 16:31:09.096183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1651/3312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:10.118672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:10.119433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:10.126667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:10.127293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:10.127728 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:10.128403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:10.128959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:10.129415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:10.194064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:10.203663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dfff6f22-04ab-4862-bc78-66e7d7cac3c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089009 Sep 13 16:31:10.204217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1662/3313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:11.226575 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.227238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:11.234129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.234613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.235090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.235780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.236236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.236664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.296583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:11.304957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0beb3d5-3bd9-44f1-b310-bcaad55398ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082233 Sep 13 16:31:11.305524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1652/3314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:12.329387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:12.330021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:12.336358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:12.336832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:12.337264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:12.337935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:12.338376 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:12.338793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:12.399272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:12.407886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9850fb01-b6a3-4e3a-b1b7-8140798d1eea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082635 Sep 13 16:31:12.408438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1663/3315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:13.431660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.432282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:13.434716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:13.439900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.440386 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.440833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.441525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.441981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.442410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.502850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:13.511582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bf93347-9385-4204-81dd-8c0f4c616acd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083807 Sep 13 16:31:13.512149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1653/3316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:14.534993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.535614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:14.541981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.542465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.542936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.543617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.544071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.544494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.608285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:14.616355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a78e6b6a-d6d6-49ef-861d-aca3ff08bf71 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085335 Sep 13 16:31:14.616908 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1664/3317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:15.641086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.641693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:15.648402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.648883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.649319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.650004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.650449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.650868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.710950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:15.719738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c183716-6444-40e6-beb8-783babe55ce5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082549 Sep 13 16:31:15.720283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1654/3318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:16.742197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.742791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:16.749937 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.750418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.750854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.751558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.752010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.752437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.812111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:16.820145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b452e4d-97db-4035-baa9-91de4871588c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081816 Sep 13 16:31:16.820707 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1665/3319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:17.844859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:17.845476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:17.852013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.852501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.852938 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.853626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.854080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.854619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.918768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:17.926812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76bf68e1-496f-4d7a-839d-2ab1eb62916b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086378 Sep 13 16:31:17.927396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1655/3320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:18.951969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:18.952593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:18.956305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:18.960165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:18.960673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:18.961115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:18.961811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:18.962291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:18.962723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:19.027223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:19.035338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4661cc5-0da4-4b82-9cf4-eb6be6493961 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088986 Sep 13 16:31:19.035900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1666/3321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:20.058046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:20.058639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:20.065061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:20.065536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:20.065965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:20.066648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:20.067134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:20.067552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:20.131473 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:20.141165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95fdae45-ccff-48c5-ad47-f733c6ce30f6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087520 Sep 13 16:31:20.141728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1656/3322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:21.165198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:21.165834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:21.173100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:21.173574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:21.174002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:21.174676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:21.175148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:21.175573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:21.237759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:21.246056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da7f3451-4fad-4f65-a414-a629145663e2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084810 Sep 13 16:31:21.246622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1667/3323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:22.268259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:22.268867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:22.275291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:22.275768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:22.276210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:22.276891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:22.277341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:22.277799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:22.337840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:22.346183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb80240f-8031-4143-9f62-3364ddd5ebe5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081817 Sep 13 16:31:22.346739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1657/3324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:23.370145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:23.370886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:23.377357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:23.377841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:23.378280 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:23.379003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:23.379459 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:23.379890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:23.454005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:23.462271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19b0fd72-df25-4d3f-b70c-2208419bd536 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.096456 Sep 13 16:31:23.462844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1668/3325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:24.485576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:24.486184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:24.493087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.493585 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.494086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.494933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.495532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.495961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.557980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:24.566072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6aea680-5e89-4192-9689-951ae03fae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084457 Sep 13 16:31:24.566627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1658/3326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:25.590388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:25.591010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:25.597613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:25.598084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:25.598511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:25.599213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:25.599658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:25.600077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:25.669118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:25.677370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ff2b67b0-4827-4f82-8f78-4d69b81d6bcf tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.091552 Sep 13 16:31:25.677874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1669/3327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:26.700892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:26.701506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:26.707896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:26.708378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:26.708815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:26.709505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:26.709958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:26.710382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:26.712930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:26.774554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:26.783066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3abb267d-9bc5-41dc-9148-b6ebb59c663b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086779 Sep 13 16:31:26.783630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1659/3328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:27.806359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:27.806923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:27.814002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:27.814489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:27.814977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:27.815698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:27.816144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:27.816564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:27.878694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:27.887898 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-562fdc54-a137-47ce-9314-961db9ec60cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085491 Sep 13 16:31:27.888460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1670/3329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:28.912032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:28.912676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:28.919336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:28.919817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:28.920254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:28.920937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:28.921387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:28.921813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:28.984614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:28.992790 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b6a01f6b-5af6-4b8d-8603-2be7dca0a63e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084629 Sep 13 16:31:28.993346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1660/3330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:30.015747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:30.016394 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:30.022858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:30.023377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:30.023820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:30.024513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:30.024971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:30.025407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:30.087321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:30.095920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5784b504-b957-4774-a299-8df7a44c7d0b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084074 Sep 13 16:31:30.096481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1671/3331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:31.119089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:31.120971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:31.127002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.127478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.127908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.128583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.129030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.129449 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.195278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:31.203816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-867f3c40-6747-459d-bb00-597cfe805a8c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088648 Sep 13 16:31:31.204374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1661/3332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:32.226636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:32.227206 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:32.233888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.234367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.234827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.235535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.235982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.236402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.297655 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:32.305786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e4d998b-2bc9-423c-8bad-979ebfb91231 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083009 Sep 13 16:31:32.306338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1672/3333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:33.329503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:33.330113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:33.336629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:33.337109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:33.337543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:33.338798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:33.339313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:33.339742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:33.399598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:33.408561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22cf4bf1-180b-4cc4-ba6a-f17d268a05b0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083187 Sep 13 16:31:33.409119 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1662/3334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:34.431546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:34.432233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:34.439377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:34.439855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:34.440285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:34.440967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:34.441416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:34.441836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:34.528381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:34.537018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2932609b-5521-4778-8ab6-082740bf47db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.109167 Sep 13 16:31:34.537626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1673/3335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:34.963853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e7a8fbf7-ee19-4f83-bff7-7117a3807ce1 req-6ea9a706-5a5b-42a7-821b-2d3213ce47ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10547c-b6b5-4dec-a8c7-3c411ac06e68", "name": "network-vif-deleted", "tag": "7cfd4a08-416c-4019-a89b-4c21ef1edae0"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:34.973763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e7a8fbf7-ee19-4f83-bff7-7117a3807ce1 req-6ea9a706-5a5b-42a7-821b-2d3213ce47ab service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:34.974173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e7a8fbf7-ee19-4f83-bff7-7117a3807ce1 req-6ea9a706-5a5b-42a7-821b-2d3213ce47ab service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:34.974604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e7a8fbf7-ee19-4f83-bff7-7117a3807ce1 req-6ea9a706-5a5b-42a7-821b-2d3213ce47ab service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:34.986869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e7a8fbf7-ee19-4f83-bff7-7117a3807ce1 req-6ea9a706-5a5b-42a7-821b-2d3213ce47ab service nova] Creating event network-vif-deleted:7cfd4a08-416c-4019-a89b-4c21ef1edae0 for instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 on hv-cinder-82002 Sep 13 16:31:34.991805 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e7a8fbf7-ee19-4f83-bff7-7117a3807ce1 req-6ea9a706-5a5b-42a7-821b-2d3213ce47ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031933 Sep 13 16:31:34.992382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1663/3336] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:35.561149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:35.561688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:35.568095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:35.568573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:35.569008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:35.569715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:35.570168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:35.570592 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:35.633409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:35.642098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce5a7c2f-c85b-4778-9c0d-f431f46757de tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085104 Sep 13 16:31:35.642657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1674/3337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:36.667067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:36.667760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:36.673876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:36.674356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:36.674796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:36.675507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:36.675962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:36.676388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:36.741071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:36.749187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85ca72fa-694f-427f-9d0e-3d584e1ad0b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087408 Sep 13 16:31:36.749748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1664/3338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:37.772158 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:37.772722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:37.779674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.780154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.780589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.781273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.781720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.782143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.843017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:37.851133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8f15be9-9d5c-4642-9ccc-22f056dc317b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082856 Sep 13 16:31:37.851691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1675/3339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:38.876500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:38.877106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:38.883484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.883958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.884391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.885151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.885644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.886063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.946377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:38.954859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67d7b6d8-730f-47cd-a50b-06db89365f57 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082238 Sep 13 16:31:38.955438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1665/3340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:39.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.980109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:39.986235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.986726 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.987210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.987903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.988359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.988788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.992751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=90 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:40.050006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:40.058222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5970ad1d-569c-4f88-b652-ef56c07fa0ee tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083217 Sep 13 16:31:40.058794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1676/3341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:41.082084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:41.082698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:41.089141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:41.089618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:41.090080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:41.090767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:41.091259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:41.091688 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:41.154109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:41.162293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f577946-353a-42c0-8910-a4359dc48e7d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084054 Sep 13 16:31:41.162851 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1666/3342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:42.186696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:42.187331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:42.193637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:42.194111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:42.194541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:42.195247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:42.195694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:42.196112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:42.257472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:42.266561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-addf3289-35cf-4fc4-97be-65713d262f76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083672 Sep 13 16:31:42.267146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1677/3343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:42 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:43.289499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:43.290108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:43.296500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:43.296976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:43.297408 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:43.298112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:43.298560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:43.299009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:43.359866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:43.367986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db2b19c7-8545-4fac-a4ec-f2b5b7750818 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082324 Sep 13 16:31:43.368554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1667/3344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:44.391626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:44.392232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:44.398646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:44.399157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:44.399593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:44.400336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:44.401273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:44.401696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:44.462085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:44.470691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ebd97de-61f1-4717-bbd1-f9936f82838d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082888 Sep 13 16:31:44.471291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1678/3345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:45.493436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:45.494103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:45.496542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:45.501979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:45.502490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:45.502976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:45.503664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:45.504114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:45.504535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:45.569920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:45.579083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-709d1b34-a115-4707-97bf-67af631e1139 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089498 Sep 13 16:31:45.579635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1668/3346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:46.602531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:46.603176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:46.610000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:46.610489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:46.610953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:46.611651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:46.612109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:46.612568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:46.673646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:46.682363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ad9185d-b4ea-45be-9941-77a121cb54a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083151 Sep 13 16:31:46.682949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1679/3347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:47.705871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:47.706394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:47.712921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:47.713401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:47.714545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:47.715329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:47.715787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:47.716213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:47.775756 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:47.784859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14a96e95-61af-4b5a-ad47-997c3bc7460c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082942 Sep 13 16:31:47.785411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1669/3348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:48.808203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:48.808845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:48.815329 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:48.815801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:48.816236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:48.816917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:48.817367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:48.817792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:48.879399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:48.888083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6c67640-3c5c-4754-9868-abf4debecd14 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083927 Sep 13 16:31:48.888645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1680/3349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:49.911206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:49.911825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:49.918378 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:49.918868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:49.919339 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:49.920037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:49.920495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:49.920919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:49.985406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:49.993547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed608e2e-7ece-45dd-8160-d019a161b326 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086265 Sep 13 16:31:49.994107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1670/3350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:51.016483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:51.017093 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:51.019568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:51.025100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:51.025563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:51.026004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:51.027328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:51.027778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:51.028202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:51.091831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:51.100013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-98dd8c20-1d41-4a53-99d7-49716bc32cb1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087520 Sep 13 16:31:51.100579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1681/3351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:52.123094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:52.123734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:52.130093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:52.130571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:52.131034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:52.131725 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:52.132178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:52.132602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:52.192857 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:52.201700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e60e7837-b866-4bbb-8d7e-7601b2c8ac1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082620 Sep 13 16:31:52.202285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1671/3352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:53.225305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:53.225916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:53.232956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:53.233438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:53.233870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:53.234551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:53.235028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:53.235452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:53.295186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:53.303241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24f0f14e-d04d-495b-953c-6f410c4cecaa tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081734 Sep 13 16:31:53.303831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1682/3353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:54.326739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:54.327373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:54.333812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:54.334272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:54.334703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:54.335413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:54.335863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:54.336285 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:54.399293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:54.407426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db26067d-0d36-4e6c-8f50-a78eb62c9d6f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085133 Sep 13 16:31:54.407981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1672/3354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:55.430914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:55.431520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:55.438542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:55.439044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:55.439475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:55.440151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:55.440596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:55.441102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:55.502671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:55.511787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d4ac1df-587e-4761-b761-58228d3e727f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083803 Sep 13 16:31:55.512388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1683/3355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:56.533558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:56.534160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:56.540564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:56.541037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:56.541468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:56.543039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:56.543526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:56.543950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:56.603555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:56.612424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65b288c1-4954-4bc9-94d0-3f11e9e915f7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082735 Sep 13 16:31:56.612976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1673/3356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:57.636173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.636893 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:57.643381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:57.643866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:57.644307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:57.644991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:57.645442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:57.645868 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:57.709016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:57.717221 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e080b9d5-c8d0-47ec-bd8b-01e112e91b6d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085433 Sep 13 16:31:57.717782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1684/3357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:58.739915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:58.740531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:58.747049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:58.747527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:58.747961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:58.748641 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:58.749091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:58.749514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:58.752087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:58.817925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:58.827007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a884d99b-5acc-48ab-85e2-5a368feebc4f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.090994 Sep 13 16:31:58.827567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1674/3358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:59.850464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.851124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:59.858125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:59.858604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:59.859067 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:59.859749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:59.860202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:59.860624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:59.921639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:59.929842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-416449c8-590e-45f4-8ab7-cf371208f85c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083251 Sep 13 16:31:59.930402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1685/3359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:00.953324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:00.953941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:00.960203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.960690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.961135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.961826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.962297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.962713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:01.024304 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:01.032576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca1e2fa4-a625-48d5-9cca-68d8d5281ce0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083380 Sep 13 16:32:01.033142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1675/3360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:02.056082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:02.056627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:02.063446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.064312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.064444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.065016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.065461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.065883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.127420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:02.136551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e819e508-8cc8-4142-a6fc-6d25b63515eb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084034 Sep 13 16:32:02.137151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1686/3361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:03.160502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:03.161122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:03.168723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.169211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.169653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.170345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.170804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.171262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.234406 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:03.242520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5639da2-395f-44e7-a71a-1d06b5de554d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085925 Sep 13 16:32:03.243181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1676/3362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:04.265196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:04.265833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:04.272230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.272711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.273150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.273831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.274283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.274736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.334952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.344334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ff28fdd-bed2-44f1-bd9a-3cf019cd2bb9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083001 Sep 13 16:32:04.344894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1687/3363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:05.367392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.368000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:05.375701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.376210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.376645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.377331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.377778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.378197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.440090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:05.449375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2dd9c0a-fbc7-407b-8696-589eff4eabdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085857 Sep 13 16:32:05.449930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1677/3364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:06.471988 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:06.472599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:06.479134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:06.479644 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:06.480080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:06.480762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:06.481211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:06.481632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:06.543977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:06.552010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d83246e-08ab-4fe7-a193-050b42b98e67 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083898 Sep 13 16:32:06.552568 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1688/3365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:07.575194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:07.576057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:07.582452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.582953 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.583392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.584076 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.584527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.584951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.647192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:07.656159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1248d717-3ffc-4409-8ee3-770243451eca tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085085 Sep 13 16:32:07.656722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1678/3366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:08.862792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:08.863477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:08.870084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.870570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.871038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.871724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.872203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.872627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.932771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.940944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfaa6838-890c-4125-9d8c-2387373d866d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.265545 Sep 13 16:32:08.941511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1689/3367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:09.964043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:09.964638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:09.971131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.971615 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.972046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.972728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.973181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.973602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:10.033700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:10.042346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38747b18-2874-4763-bf82-ad489b38ba5b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082213 Sep 13 16:32:10.043171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1679/3368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:11.065721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:11.066328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:11.068334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:32:11.068461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:32:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c (ip 10.222.0.50) !!! Sep 13 16:32:11.075623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.076106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.076544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.077231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.077682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.078102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.081348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=84 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:11.140386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:11.148572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1f867ea-d051-491b-85d5-e0598c1f0bd0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086858 Sep 13 16:32:11.149140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1690/3369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:12.172281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.172836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:12.179347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.179834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.180278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.180971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.181430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.181861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.244872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:12.253200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89775a93-f64b-4c55-a3be-4786ae885065 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084887 Sep 13 16:32:12.253760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1680/3370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:13.275928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:13.276550 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:13.283178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:13.283666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:13.284109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.284800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:13.285254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:13.285685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.347168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.355885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-924bb53d-892d-4a99-9dad-4b95e4fdfb43 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083965 Sep 13 16:32:13.356451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1691/3371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:14.379915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:14.380518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:14.387313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.387791 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.388223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.388900 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.389348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.389795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.451838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:14.459817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c19ec8b-5e8a-40f7-a2df-f68559b5aa9b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083725 Sep 13 16:32:14.460369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1681/3372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:15.483737 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:15.484347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:15.490891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.491402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.491843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.492537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.492997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.493450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.559598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:15.567653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a037efce-d935-4307-85be-81289ac9de63 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088055 Sep 13 16:32:15.568224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1692/3373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:16.591249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:16.591868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:16.594246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:32:16.594390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c (ip 10.222.0.50) !!! Sep 13 16:32:16.595427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:16.602103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.602587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.603056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.603746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.604203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.604627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.668118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:16.676216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34bd4895-1774-4014-9034-f5ed0a928bdc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.089087 Sep 13 16:32:16.676767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1682/3374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:17.701172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:17.701811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:17.704332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:32:17.704480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c (ip 10.222.0.50) !!! Sep 13 16:32:17.716106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:17.716537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:17.717004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.717721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:17.718236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:17.718661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.779417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:17.787588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0eabb148-cb45-44ad-8108-f4419dc96e9d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.091531 Sep 13 16:32:17.788151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1693/3375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:18.810310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:18.810930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:18.817360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.817839 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.818272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.818976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.819432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.819855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.880952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.889716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-988249a6-c3f1-49f4-8906-f5b04b97fc2f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083989 Sep 13 16:32:18.890275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1683/3376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:19.911969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.912560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:19.919417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.919889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.920321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.920994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.921439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.921861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.986915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:19.995213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5156389a-ec89-40dc-a1f1-e45ced1dbdd1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087025 Sep 13 16:32:19.995773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1694/3377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:21.018282 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:21.018887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:21.025591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:21.026067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:21.026501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:21.027219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:21.027667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:21.028092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:21.091222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:21.099381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-427f56da-3b02-4e55-a25c-06c65fa9f683 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084953 Sep 13 16:32:21.099943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1684/3378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:22.122746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:22.123325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:22.125670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:22.130779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:22.131304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:22.131743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:22.132460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:22.132916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:22.133344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:22.193039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:22.201447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6066b45b-9063-4237-9c40-102270a5f2b2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083163 Sep 13 16:32:22.202009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1695/3379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:23.224035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:23.224638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:23.231106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.231576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.232005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.232680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.233124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.233538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.293206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:23.301107 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-314b22c0-5b0e-48cd-aef6-1b2d6f1b38fd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.080899 Sep 13 16:32:23.301657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1685/3380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:24.325299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:24.326170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:24.332612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.333091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.333526 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.334197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.334645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.335097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.395514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:24.404805 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-058afae8-35c5-4f5e-850f-5ad5a0fbbf11 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084382 Sep 13 16:32:24.405362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1696/3381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:25.428204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:25.428837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:25.432029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:32:25.432211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c (ip 10.222.0.50) !!! Sep 13 16:32:25.438579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.439099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.439530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.440222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.440665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.441128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.521765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:25.529888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5087093-9c3c-4887-bbc8-ae547d5cf941 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.105662 Sep 13 16:32:25.530448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1686/3382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:26.552808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:26.553402 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:26.559794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:26.560271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:26.560702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:26.561375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:26.561822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:26.562240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:26.623009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:26.631123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31f3315c-4d0a-4c3e-9e25-d16cf457b714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082159 Sep 13 16:32:26.631679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1697/3383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:27.655515 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:27.656130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:27.662467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.662973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.663414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.664095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.664547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.664969 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.729039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:27.737152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f79c9ff-92e9-4900-8ee2-6173fbb20854 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085486 Sep 13 16:32:27.737714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1687/3384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:28.761245 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:28.761873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:28.768254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:28.768727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:28.769154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:28.769827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:28.770274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:28.770693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:28.833915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:28.842328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f354372-42d7-466e-9976-981ec3f39c9c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085853 Sep 13 16:32:28.842892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1698/3385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:29.865778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.866397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:29.872508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.872992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.873428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.874115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.874571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.875035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.878866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:29.938015 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:29.946439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-893a0d2a-8c49-47ac-ac29-893cf5082245 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084559 Sep 13 16:32:29.947657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1688/3386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:30.970442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:30.971192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:30.977674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:30.978756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:30.979222 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:30.979909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:30.980362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:30.980794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:31.041542 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:31.049727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2c173f3-8a7b-4112-87a9-426367641519 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083121 Sep 13 16:32:31.050290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1699/3387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:32.073308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:32.073946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:32.080599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.081080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.081516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:32.082200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.082651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.083106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:32.143413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:32.151890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e423b9f-89a8-4e73-a7e1-819d4fda7b9f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083073 Sep 13 16:32:32.152450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1689/3388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:33.174317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:33.174940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:33.181875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.182538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.183000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.183691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.184140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.184563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.247311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:33.255505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba687150-d53e-4717-9c57-628d0a8ee61a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085088 Sep 13 16:32:33.256077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1700/3389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:34.279693 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:34.280366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:34.287108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:34.287590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:34.288024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:34.288718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:34.289173 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:34.289596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:34.350510 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:34.358860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4171da22-a690-46ba-a8d4-0095e55d915b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083985 Sep 13 16:32:34.359444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1690/3390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:35.380756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:35.381375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:35.388775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:35.389263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:35.389704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:35.390392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:35.390849 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:35.391303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:35.453549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:35.461614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e4f3a94-a076-4989-a5f0-c8f341791581 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084766 Sep 13 16:32:35.462729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1701/3391] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:36.485251 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:36.485866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:36.492403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:36.492895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:36.493334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:36.494677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:36.495164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:36.495595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:36.556547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:36.564757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0dc9540-b1f3-4238-af4f-c517ed281947 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083323 Sep 13 16:32:36.565325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1691/3392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:37.588081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:37.588722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:37.595088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:37.595565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:37.595999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:37.596673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:37.597117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:37.597536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:37.661767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:37.670084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1718997e-a2c3-45d1-8961-0a09265ff6b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085904 Sep 13 16:32:37.670637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1702/3393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:38.693654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:38.694271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:38.701538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.702022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.702497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.703223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.703680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.704113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.764050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:38.772225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0adb5419-e560-4873-846c-c2c78beee17d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082421 Sep 13 16:32:38.772797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1692/3394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:39.796168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:39.796777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:39.802597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.803112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.803548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.804226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.804676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.805091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.866718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:39.875182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7a52b07-a995-4041-9395-46a7355327db tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082954 Sep 13 16:32:39.875749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1703/3395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:40.898105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:40.898717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:40.905340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:40.905822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:40.906256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:40.907080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:40.907542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:40.907967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:40.968161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:40.976254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2dd21976-2265-4e27-ae6b-fc2cb719cc86 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081984 Sep 13 16:32:40.976816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1693/3396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:41.999958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:42.000598 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:42.007005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.007489 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.007925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.008608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.009717 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.010145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.012677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=84 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:42.073774 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:42.082198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86e045f5-073e-49bc-8492-c707c473af4e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086055 Sep 13 16:32:42.082757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1704/3397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:43.105169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:43.105782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:43.112164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:43.112644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:43.113080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:43.113765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:43.114216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:43.114639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:43.220417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:43.228587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d5842e4-e562-4475-8308-071cd71fb779 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.127630 Sep 13 16:32:43.229148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1694/3398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:44.250305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:44.250933 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:44.257356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.257834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.258266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:44.258986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.259434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.259860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:44.364724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:44.373358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05bed995-d4d2-49c6-8d03-d04a51dd6e9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.126855 Sep 13 16:32:44.373913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1705/3399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:45.395843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:45.396458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:45.403359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.403842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.404297 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.404964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.405444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.405871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.466268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.474356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f52e16fa-a878-4009-bf8a-165a2e0fd361 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082359 Sep 13 16:32:45.474932 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1695/3400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:46.498471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:46.499112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:46.503493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:32:46.503637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c (ip 10.222.0.50) !!! Sep 13 16:32:46.514154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.514636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.515099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.515796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.516243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.516671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.581481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:46.590192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c5681c0-ed64-47e7-8c9c-b151d5050442 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.095661 Sep 13 16:32:46.590756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1706/3401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:47.614128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:47.614740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:47.617078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:47.622224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.622707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.623174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.623864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.624314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.624737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.686692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:47.694830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8671bd3-eb21-43f4-ad78-7bdb7b9a9119 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084595 Sep 13 16:32:47.695426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1696/3402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:48.718563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:48.719203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:48.725620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:48.726100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:48.726989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:48.727246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:48.727771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:48.728192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:48.789259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:48.797338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4fa9f48b-d892-4810-b7ce-d08b6eb06a2e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082645 Sep 13 16:32:48.797896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1707/3403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:49.820714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:49.821763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:49.828390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.828867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.829301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.829977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.830424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.830842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.890664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:49.898770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bf0a29a-9126-4d2a-b2f4-1ccdbfc0a00a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081979 Sep 13 16:32:49.900293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1697/3404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:50.922278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:50.923016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:50.929374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.929845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.930275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.931484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.931930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.932346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.996470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:51.004660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa515b4c-c653-4681-b9a6-5444eae7fe1d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086212 Sep 13 16:32:51.005226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1708/3405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:52.028558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:52.029170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:52.035609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.036092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.036531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.037225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.037678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.038102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.100003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:52.108261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4897fca6-6693-4676-81a2-9842a457a0e5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084174 Sep 13 16:32:52.108821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1698/3406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:53.130977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:53.131589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:53.133952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:53.139735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.140238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.140672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.141354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.141796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.142211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.203641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:53.212241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76ac3419-f66f-4369-a6fe-df7289b7617f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084556 Sep 13 16:32:53.213098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1709/3407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:53 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:54.235482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:54.236120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:54.242516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.243610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.244049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.244752 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.245192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.245614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.305528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:54.314227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-caa1c34a-7a0d-4a40-84f0-7d5fed1f412b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082579 Sep 13 16:32:54.314789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1699/3408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:55.337386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:55.338005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:55.345109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.345593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.346034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.346727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.347214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.347641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.410808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.419710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07765a88-e95e-4386-856a-b408f1683d03 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086225 Sep 13 16:32:55.420267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1710/3409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:56.441629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:56.442230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:56.449314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.449801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.450236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.451208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.451658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.452081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.514621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:56.522979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9beaab1-6a29-4563-b2a4-5658bd70fa83 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085096 Sep 13 16:32:56.523551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1700/3410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:57.546462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:57.547096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:57.553482 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.553960 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.554388 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.555096 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.555544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.555963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.616602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.625035 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c3a4749-0457-4c74-979e-dffd128341f4 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083506 Sep 13 16:32:57.625604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1711/3411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:58.647368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:58.647982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:58.654590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.655112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.655566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.656238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.656691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.657115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.718677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:58.726808 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31d5760c-3c1b-4701-b728-f22336a25f35 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083299 Sep 13 16:32:58.727397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1701/3412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:59.750242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:59.750787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:59.757289 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:59.757771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:59.758208 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:59.758912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:59.759365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:59.759788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:59.822827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:59.831571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-149c207e-7ef8-4b67-b364-0672f57e0c42 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085294 Sep 13 16:32:59.832132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1712/3413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:00.854402 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:00.855090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:00.862267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:00.862747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:00.863219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:00.863911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:00.864369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:00.864804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:00.868965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:01.179482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:01.188163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-beb9f81d-7aae-41bb-88ca-6778d1b8cfb0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.337869 Sep 13 16:33:01.188740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1702/3414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:02.212733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:02.213338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:02.220209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:02.220684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:02.221119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:02.221795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:02.222240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:02.222660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:02.282919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:02.290978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09186aaf-b8ac-4524-8377-23f256158e68 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082093 Sep 13 16:33:02.291544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1713/3415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:03.313697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:03.314245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:03.320557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.321033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.321464 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.322143 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.322587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.323035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.383093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:03.391782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52fce231-5a5b-485c-a685-393ff8ccd94b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082072 Sep 13 16:33:03.392342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1703/3416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:03 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:04.415231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.415842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:04.423002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.423480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.423910 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.424588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.425033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.425452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.488419 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:04.496513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe167e8b-ab41-4834-b36d-f0dd115367cb tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085124 Sep 13 16:33:04.497440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1714/3417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:05.519035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:05.519643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:05.525974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:05.526452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:05.526889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:05.527586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:05.528037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:05.528456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:05.590412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:05.598571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7291da49-cc96-46bb-9316-970e659a1e8f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083375 Sep 13 16:33:05.599159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1704/3418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:06.621362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:06.622623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:06.628852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.629327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.629758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.630429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.630875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.631315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.691457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:06.699596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37f0dc87-b70b-4ddc-bf71-0733ca1998e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082091 Sep 13 16:33:06.701183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1715/3419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:07.724033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:07.724798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:07.731463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.731944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.732385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.733083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.733541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.733972 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.793887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.802071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1fc39dcd-8537-447c-9dfd-ebcbdcd3546d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082071 Sep 13 16:33:07.802639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1705/3420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:08.825863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:08.826642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:08.833063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:08.833540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:08.833971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:08.834646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:08.835118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:08.835611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:08.896386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:08.905122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88a79c86-96be-44ac-92e4-1337bacaf57a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083765 Sep 13 16:33:08.905684 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1716/3421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:09.928459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:09.929110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:09.935614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.936102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.936543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.937228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.937686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.938112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.000702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:10.008786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a42280c-3ab3-4771-bc22-18aa944b34cc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084179 Sep 13 16:33:10.009340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1706/3422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:11.032749 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:11.033396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:11.043409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.043409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.043409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.043409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.043827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.043827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.103341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:11.111632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b675c29-b68e-4c37-83ae-fc7725a064ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083541 Sep 13 16:33:11.112209 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1717/3423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:12.134382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:12.135016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:12.141620 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.142099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.142533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.143246 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.143699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.144120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.206930 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.214947 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca05998c-496a-4b03-8cc0-7a3bead98fa3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084449 Sep 13 16:33:12.215520 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1707/3424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:13.238194 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:13.238798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:13.245166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.245642 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.246074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.247945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.248437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.248861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.251359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=84 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:13.310821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:13.319022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-068855e6-4678-48b4-805b-6fad05085820 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084553 Sep 13 16:33:13.319511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1718/3425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:14.342460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:14.343097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:14.349435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.349906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.350335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.351042 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.351488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.351909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.413700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.422608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10f0b3c1-de9f-407e-8729-851e10273bdd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084709 Sep 13 16:33:14.423211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1708/3426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:14 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:15.444926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:15.445540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:15.452375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.452862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.453304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.453990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.454454 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.454882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.515458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:15.523577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50b07d3a-be5a-44f1-8e8c-2a4d8de219ab tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082515 Sep 13 16:33:15.524141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1719/3427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:16.547135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:16.547749 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:16.554082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.554563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.555033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.555731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.556183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.556605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.619467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.628415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4b0f15b-4322-4a83-b29e-481f34e41746 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085436 Sep 13 16:33:16.628982 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1709/3428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:17.650675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.651318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.659044 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.659530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.659971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.660662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.661120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.661551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.722727 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.731300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e30ed08a-228c-4ec5-badd-49788a77de60 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084405 Sep 13 16:33:17.731864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1720/3429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:18.754385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:18.755028 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:18.757421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:18.762462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.762958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.763399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.764072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.764517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.765253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.828690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.836763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0254736d-e914-4c7d-8346-8ce23a7da722 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086301 Sep 13 16:33:18.837321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1710/3430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:19.860701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:19.861308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:19.867724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.868199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.868631 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.869308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.869755 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.870178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.932179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:19.941271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80e95bbd-8d21-4ab9-857c-5802fbaa147f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084998 Sep 13 16:33:19.941831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1721/3431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:20.964710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:20.965314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:20.971893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.972372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.972811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.973497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.973950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.974375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.033917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:21.042058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebb303a5-4ce4-43ca-8a6f-f1c27ae81b79 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081233 Sep 13 16:33:21.042618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1711/3432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:22.064958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:22.065391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:22.071837 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.072309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.072740 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.073422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.073867 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.074285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.133964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:22.141917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c04e55a8-0244-4b23-b207-68d4079fb4c0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081627 Sep 13 16:33:22.142470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1722/3433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:23.164430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:23.165036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:23.171958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.172434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.172867 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.173546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.173993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.174413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.237733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.245797 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-208fa5f7-4d94-40ef-99d6-de547dcfeae9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085269 Sep 13 16:33:23.246366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1712/3434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:24.268929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:24.269540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:24.271890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:24.277019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.277503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.277938 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.278622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.279103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.279527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.340504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:24.348720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ec868c20-087e-4751-98cd-34284a56b815 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083765 Sep 13 16:33:24.349310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1723/3435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:24 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.371746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:25.372356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:25.379626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.380104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.380538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.381217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.381666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.382082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.442367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:25.450681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5a7c64a-fa7e-4632-8e02-8ce72238a953 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082552 Sep 13 16:33:25.451295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1713/3436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:26.474228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.474835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.482433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.483083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.484576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.485328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.485784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.486244 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.548829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.557031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8afcee6c-1db8-47be-ae15-070c08d0cf89 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086546 Sep 13 16:33:26.557595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1724/3437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:27.581008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:27.581658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:27.588068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.588556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.588997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.589690 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.590148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.590579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.652746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:27.661004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29e6a706-4866-40ad-8c8e-2bb32b3b96b1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084514 Sep 13 16:33:27.661570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1714/3438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:28.683885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:28.684498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:28.690884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:28.691399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:28.691841 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:28.692530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:28.692987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:28.693416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:28.754866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:28.762966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbe0fd37-4705-414d-9e83-7e5b68a09503 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083001 Sep 13 16:33:28.763538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1725/3439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:29.786709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:29.787296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:29.793252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.793726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.794156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.794832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.795307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.796871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.861646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.869755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf66f228-c76b-409e-a3b0-a67399e139b3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087340 Sep 13 16:33:29.870308 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1715/3440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:30.892638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:30.893246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:30.899689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.900168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.900600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.901285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.901733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.902157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.962915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:30.971721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7fae0cca-e77c-49e6-8688-6f54676cffd7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083595 Sep 13 16:33:30.972281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1726/3441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:31.994089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:31.994701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:32.001200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.001680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.002163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.002847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.003329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.003753 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.007583 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:32.065379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:32.073512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75aed68b-4840-42de-b473-697e1e01a2df tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083250 Sep 13 16:33:32.074056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1716/3442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:33.096347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.096957 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:33.103398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.103870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.104298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.104969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.105414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.105833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.165429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:33.174281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16c93dec-a01b-4849-bf29-820d3cc41474 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.081844 Sep 13 16:33:33.174840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1727/3443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:34.197759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:34.198364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:34.205708 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.206183 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.206619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.207322 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.207771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.208191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.272823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:34.280973 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3245cb4-3296-4f35-a7d7-60a55e78aab2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087128 Sep 13 16:33:34.281531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1717/3444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:35.303618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:35.304212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.310549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.311069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.311507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.312188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.312635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.313056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.375690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:35.383801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6335291-0c3e-423f-9929-427a0f5a0230 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084017 Sep 13 16:33:35.384367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1728/3445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:36.407058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:36.407665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:36.414105 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.414589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.415059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.415745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.416195 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.416618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.478179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:36.487309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-73882ea7-2136-4a9d-b305-4f2b7b164d82 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084107 Sep 13 16:33:36.487862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1718/3446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:37.512189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.512965 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.520166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.520646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.521083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.521767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.522216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.522639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.584606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.592832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2713859-ada4-4e28-8497-909618fa1d6e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084340 Sep 13 16:33:37.593391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1729/3447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.615437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.616073 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.622328 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.622803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.623265 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.623980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.624497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.624918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.688458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.696654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a99bf0d5-7ac8-400d-a40b-ea8ae4c05d51 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085039 Sep 13 16:33:38.697217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1719/3448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:39.719712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:39.720320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:39.726406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.726885 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.727350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.728038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.728490 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.728914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.789100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.797829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ae90e677-4457-48e9-8659-b9d59526ae05 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082554 Sep 13 16:33:39.798433 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1730/3449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:39 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:40.820419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.821008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.827931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.828411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.828848 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.829531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.829981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.830422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.890764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.898834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8b086e5-cf47-4f24-8527-c8cf372fc558 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082329 Sep 13 16:33:40.899431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1720/3450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:41.921615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:41.922232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:41.928758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.929249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.929689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.930378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.931126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.931557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.992943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.001593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8ccb9c3-b458-4eae-8ab3-cc95917d86c8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083964 Sep 13 16:33:42.002163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1731/3451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:41 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:43.025648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.026192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.033380 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.033859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.034291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.035044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.035512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.035940 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.101584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:43.109669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8330ebd8-158e-43b7-99b3-d08c863b944c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087969 Sep 13 16:33:43.110225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1721/3452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:44.132351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:44.132959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:44.139591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.140068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.140497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.141174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.141620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.142038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.144559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=84 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:44.204683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.212679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6a28372-ab4d-412c-867f-174b63ec1d9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084181 Sep 13 16:33:44.213231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1732/3453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:44 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:45.236582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:45.237197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:45.243788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.244357 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.244727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.245379 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.245828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.246253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.306985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.315879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-458b51a2-35c1-451d-a2d0-5de3a1c3c3b5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083675 Sep 13 16:33:45.316374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1722/3454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:45 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:46.338677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:46.339330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:46.345948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.346430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.346866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.347576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.348027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.348452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.409466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.417605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5f33b5ec-d3d3-4638-b76d-006cb3ffae02 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082772 Sep 13 16:33:46.418172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1733/3455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:46 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:47.440639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:47.441260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:47.447625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.448108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.448541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.449222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.449671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.450096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.515196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:47.523639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5eeac89b-0557-4a06-8d4e-d1438639e1ea tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086847 Sep 13 16:33:47.524202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1723/3456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:47 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:48.548055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.548661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.555606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.556532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.556984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.557966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.558648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.559106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.620131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.628624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38ba658a-bbc9-44ca-81b0-cdc5ea2865f3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085218 Sep 13 16:33:48.629184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1734/3457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:49.651915 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.652519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.655687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:49.660863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.661336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.661773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.662452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.662922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.663337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.724815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.733240 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6bdcac5-ba75-4436-b53b-1aea8ee25032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084957 Sep 13 16:33:49.733809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1724/3458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:50.756148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.756750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.763167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.763674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.764442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.765138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.765588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.766010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.828730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.836815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5bbec426-dfed-4ffd-b018-bfce690885fc tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084679 Sep 13 16:33:50.837379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1735/3459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:51.860366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.860975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.867483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.867961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.868390 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.869099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.869544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.869964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.933413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.942422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1ba3e34e-0e73-4cc9-899f-19a79a416e9e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086553 Sep 13 16:33:51.942998 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1725/3460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:52.965953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:52.967276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:52.974109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.974588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.975059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.975736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.976182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.976602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.037537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.045927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e13b5d2-503d-4444-a20c-51dd5fab0ea0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084170 Sep 13 16:33:53.046486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1736/3461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:52 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:54.123814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:54.124424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:54.130784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.131294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.131736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.132416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.132866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.133288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.193493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.202373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86c03e48-5f2c-4819-aea0-ecf11aaa58a7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082380 Sep 13 16:33:54.202918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1726/3462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:54 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:55.225544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.226162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.228518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:55.234856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.235751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.236413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.237123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.237588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.238020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.298858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.307094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b20c1e2e-502f-433a-8171-cd1d7f207a0f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085348 Sep 13 16:33:55.307666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1737/3463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:56.330729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.331374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:56.337680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.338157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.338586 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.339293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.339740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.340159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.405270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:56.413319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16206ff4-dddd-4ab4-b620-f2cabb2d4432 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.087169 Sep 13 16:33:56.413874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1727/3464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:57.436986 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:57.437591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:57.444038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.444513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.444941 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.445614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.446058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.446473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.507696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:57.516529 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9c64cc6-923f-4e4d-ae57-2fd4e3fd7ab6 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083642 Sep 13 16:33:57.517409 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1738/3465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:57 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:58.539013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:58.539670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:58.546838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.547345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.547781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.548458 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.548904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.549323 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.611606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.619635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b9c7bae-ef5f-4555-9e7f-bb6ef6381cae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084478 Sep 13 16:33:58.620181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1728/3466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:58 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:59.643017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:59.643637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:59.650374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.650854 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.651320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.652004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.652452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.652878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.715636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:59.723904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-98d76da6-c647-4a9c-8cf0-9b54c04137ac tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085410 Sep 13 16:33:59.724467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1739/3467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:59 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:00.746234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:00.746782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:00.752876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.753359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.753801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.754483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.754961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.755420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.818444 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.826911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c69ec2ad-033f-4762-9ed5-3acccd828a80 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084845 Sep 13 16:34:00.828049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1729/3468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:00 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:01.851565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.852184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.858539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.860020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.860458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.861151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.861610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.862039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.922686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.931005 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58f2f6a0-05f1-4425-b612-3f17a99c985f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083278 Sep 13 16:34:01.931574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1740/3469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:02.955291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:02.955902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:02.962254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.962733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.963211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.963891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.964341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.964763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.967268 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:03.025561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:03.033760 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8094f61f-4a9c-424e-be6f-56ffd724a219 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083281 Sep 13 16:34:03.034325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1730/3470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:02 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:04.057434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:04.058030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:04.064742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.065224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.065659 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.066375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.066827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.067309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.130185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.138296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18891796-03e9-46f4-a9f0-2bf24f568a76 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084785 Sep 13 16:34:04.138855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1741/3471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:04 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:05.162220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.162837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.169821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.170303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.170736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.172264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.172826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.173254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.236580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.244658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ac11153-90db-4702-8cdc-5a60f150ac47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086351 Sep 13 16:34:05.245216 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1731/3472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:06.267844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.268448 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.275192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.275673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.276111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.276788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.277403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.277983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.339370 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.348582 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6178654-0858-422b-864d-5784fa6e3e6b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085296 Sep 13 16:34:06.349144 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1742/3473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:07.371208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:07.371825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:07.378698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.379208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.379649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.380341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.380798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.381226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.442002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:07.450108 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1661265-8b71-48ed-9e54-aa6c2b6db1ba tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082837 Sep 13 16:34:07.450957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1732/3474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:07 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:08.473702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:08.474324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:08.480778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.481262 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.481704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.482392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.482847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.483300 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.544549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:08.553171 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c906568d-7cc7-4311-a22e-b42837367032 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083402 Sep 13 16:34:08.553946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1743/3475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:08 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:09.576306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:09.576946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:09.584037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:09.584516 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:09.584978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:09.585661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:09.586111 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:09.586538 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:09.649243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:09.657551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57855a5e-2a1a-4f06-9113-cdf81fbea763 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085335 Sep 13 16:34:09.658109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1733/3476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:09 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:10.680677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:10.681241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:10.688117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:10.688600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:10.689036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.689722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:10.690174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:10.690599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.750772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:10.758802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc645816-bb47-42c5-ad46-38d7d4fe246a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082077 Sep 13 16:34:10.759403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1744/3477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:10 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:11.781629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:11.782157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:11.788469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.788943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.789374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.790049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.790500 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.790937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.854511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.862778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec5d078b-c1de-4f98-9f11-d9a3e44690b7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085166 Sep 13 16:34:11.863375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1734/3478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:11 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:12.886290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:12.886909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:12.894032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.894503 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.894962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.895638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.896083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.896502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.957809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:12.966317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fc7d3c8d-a000-4a1e-bb40-d81480683a77 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083853 Sep 13 16:34:12.966872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1745/3479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:12 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:13.990375 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:13.991013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:13.997502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.997980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.998436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.999197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.999685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.000110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.062818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.071050 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f001f978-4d68-46ae-82fb-40fed971c714 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084557 Sep 13 16:34:14.071612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1735/3480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:13 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:15.095129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:15.095750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:15.102122 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.102597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.103059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.103736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.104184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.104605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.108791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=84 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:15.165608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.174536 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c25d83a-0823-47b3-bfa5-ea932de833ae tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084335 Sep 13 16:34:15.175129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1746/3481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:15 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:16.197530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:16.198140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:16.200125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:34:16.200271 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:34:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c (ip 10.222.0.50) !!! Sep 13 16:34:16.207094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.207579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.208016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.208702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.209152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.209577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.270474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:16.278446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b621ab5-88e8-40e6-8f99-b603291fe0a1 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084820 Sep 13 16:34:16.279036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1736/3482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:16 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:17.302125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:17.302758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.309116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.309586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.310012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.310683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.311218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.312180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.372456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.381410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f560d419-44c8-403d-85f9-4afb35f9df13 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082889 Sep 13 16:34:17.381968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1747/3483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:17 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:18.403568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:18.404166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:18.411594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.412085 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.412560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.413284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.413742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.414168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.477822 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:18.486371 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bef3494f-10a4-442e-a096-6f54d87205ed tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.086648 Sep 13 16:34:18.486977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1737/3484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:18 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:19.509567 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:19.510178 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:19.516742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.517231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.517695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.518387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.518844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.519301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.584845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:19.593861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e4d68c33-a998-4f67-83cc-a9e3b43eeb08 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088087 Sep 13 16:34:19.594428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1748/3485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:19 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:20.616326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:20.616943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:20.619295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:20.625045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.625533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.625970 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.626663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.627146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.627581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.687570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:20.695710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25822834-e878-46bb-a9d4-641dc9d09bda tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083246 Sep 13 16:34:20.696309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1738/3486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:20 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:21.719031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:21.719646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:21.726205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.726687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.727152 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.727834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.728292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.728715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.790169 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:21.799195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34243d76-d5aa-4f7e-8908-7a054195f52e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084339 Sep 13 16:34:21.799754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1749/3487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:21 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:22.821578 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:22.822182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.831993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.831993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.832653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.833181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.833621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.834155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.898009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:22.906324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4cd133b1-970d-4415-99f2-bf66642b92c7 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088666 Sep 13 16:34:22.906881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1739/3488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:22 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:23.929984 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:23.930588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:23.937537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.938015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.938455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.939166 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.939621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.940046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.003810 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:24.011951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82cfb055-cf47-42d6-bcec-0744ab9d4d47 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085795 Sep 13 16:34:24.012517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1750/3489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:23 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:25.035347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.035939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.043417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.043417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.043417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.044054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.044507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.044933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.109128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:25.117199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c9df405-9c9e-4c2c-a4f8-6e061c09124b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085771 Sep 13 16:34:25.117758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1740/3490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:26.141283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:26.141890 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:26.144330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:26.149635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.150119 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.150559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.151269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.151723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.152145 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.213258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:26.221666 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c37848c-2fcd-4584-a920-5022afa6913b tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084966 Sep 13 16:34:26.222225 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1751/3491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:26 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:27.244543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:27.245147 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:27.251644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.252124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.252554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.253228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.253692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.254094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.317868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:27.326267 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2404dde8-3594-4454-8652-cbb68c1aa97a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085579 Sep 13 16:34:27.326906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1741/3492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:27 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:28.348136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:28.348787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:28.355460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.355942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.356379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.357061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.357511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.358007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.421319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:28.429557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-723f974b-23f0-46a5-8f97-882e5c2a91d2 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.085269 Sep 13 16:34:28.430127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1752/3493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:28 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:29.453868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:29.454501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:29.460657 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.461164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.461601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.462307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.462757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.463212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.523259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:29.532043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c58fcb7a-90dc-4908-8bb8-a12006b4654a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.082819 Sep 13 16:34:29.532613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1742/3494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:29 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:30.555418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.556026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:30.562510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.563030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.563467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.564150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.564596 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.565015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.631985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:30.640283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f81462d6-0c26-4789-9c5c-a9d4957e24f5 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088850 Sep 13 16:34:30.640848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1753/3495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:31.663465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:31.664114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:31.671211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.671734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.672176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.672871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.673327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.673759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.735453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:31.743420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4892b3f1-509e-4b92-85c1-a68e84585098 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083845 Sep 13 16:34:31.743979 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1743/3496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:31 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:32.766981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:32.767597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:32.773945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.774429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.774865 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.775593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.776025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.776450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.837332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:32.846226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d31831a7-694a-4653-a83e-290bdb9a2ac9 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083233 Sep 13 16:34:32.846808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1754/3497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:32 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:33.868489 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:33.869097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:33.876084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.876561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.876993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.877675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.878122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.878542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.882389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:33.939838 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:33.947975 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9865b101-c1a2-4ac3-867a-0547300721ce tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.083391 Sep 13 16:34:33.948527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1744/3498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:33 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:34.972042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.972874 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.979196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.979688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.980139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.980826 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.981301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.981721 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.047967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:35.056261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5ccc0a8-2363-4694-9875-7d8fe9d07f1e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.088129 Sep 13 16:34:35.056822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1755/3499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:36.079780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:36.080394 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:36.087604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.088091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.088587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.089532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.089989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.090417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.150828 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:36.159140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14590edb-c33e-435b-954c-33d2c0b37af3 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1369 microversion: 2.1 time: 0.084128 Sep 13 16:34:36.159697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1745/3500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:36 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:36.182293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e69d702-c83b-4525-ab6f-e4cdf3a12b2d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '.version_select at 0x7fb67c306af0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:36.205901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e69d702-c83b-4525-ab6f-e4cdf3a12b2d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316772910" status: 202 len: 0 microversion: 2.1 time: 0.027314 Sep 13 16:34:36.206460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1756/3501] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Sep 13 16:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316772910 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:34:37.089815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c6baa1f-a08e-4b35-afd9-b454eb1d754e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'create', calling method: .version_select at 0x7fb67c448550>, body: {"keypair": {"name": "tempest-keypair-67608362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDS8H3EP39DHnFNRUN4YmcGEMCLEj5zr4dJaXyCDDsenMmrKAVfUIXH+d831dJglmf0BVssPzSRe26flxkE3qrRIiMOLAhZOhqVuGD5YfxeJqynR7BgAHyTpTAqQwGMF1Q=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:37.106007 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5c6baa1f-a08e-4b35-afd9-b454eb1d754e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for project 4eb7191b18cc41de8c9c51672246991d. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:37.110889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5c6baa1f-a08e-4b35-afd9-b454eb1d754e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for user e1cbafa1d3c244c5906e475494b39d4c and project 4eb7191b18cc41de8c9c51672246991d. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:37.137499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c6baa1f-a08e-4b35-afd9-b454eb1d754e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.051560 Sep 13 16:34:37.138113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1746/3502] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:34:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:38.344829 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-220477955", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f1df069-b219-4388-80e0-212b82e58fde"}], "security_groups": [{"name": "tempest-securitygroup--1330582927"}], "key_name": "tempest-keypair-67608362", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:38.449232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] validate_networks() for [('6f1df069-b219-4388-80e0-212b82e58fde', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:39.096273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:39.096699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:39.097204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:39.097645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:39.098055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:39.106762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.107271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.107743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.108439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.108892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.109322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.125715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for project 4eb7191b18cc41de8c9c51672246991d. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:39.129716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Getting quotas for user e1cbafa1d3c244c5906e475494b39d4c and project 4eb7191b18cc41de8c9c51672246991d. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:39.145021 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:39.147420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:39.194557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b631e2e-310e-4e6e-8165-34e35fdd2fef tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854711 Sep 13 16:34:39.195266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1757/3503] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:34:39.207664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00d9ca09-ebd0-4fdc-91da-f41b2f820966 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:39.208300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00d9ca09-ebd0-4fdc-91da-f41b2f820966 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:39.260483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00d9ca09-ebd0-4fdc-91da-f41b2f820966 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:39.268270 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00d9ca09-ebd0-4fdc-91da-f41b2f820966 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1235 microversion: 2.1 time: 0.064970 Sep 13 16:34:39.268843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1747/3504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:39 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1235 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:40.292040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:40.292649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.300123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.300599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.301031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.301706 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.302153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.302575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.363888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:40.371761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22ed6743-2b5a-41ce-9cb7-cf9aadedb0a0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1287 microversion: 2.1 time: 0.084050 Sep 13 16:34:40.372251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1758/3505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:40 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:41.394441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:41.395103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:41.401286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.401793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.402223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.402958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.403410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.403830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.607672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:41.615457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14d2e1a2-e750-4396-bdf3-bf999f02011c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1361 microversion: 2.1 time: 0.224986 Sep 13 16:34:41.616024 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1748/3506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:41 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:41.931716 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-e92e630e-1441-4312-ba9f-f369fbc751db req-16b3eb97-5a5e-41ff-9002-14cd9d34fa0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10", "tag": "70f67253-4c0c-45c0-9628-fba53f8172e5"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:41.942252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e92e630e-1441-4312-ba9f-f369fbc751db req-16b3eb97-5a5e-41ff-9002-14cd9d34fa0b service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.942731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e92e630e-1441-4312-ba9f-f369fbc751db req-16b3eb97-5a5e-41ff-9002-14cd9d34fa0b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.943189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e92e630e-1441-4312-ba9f-f369fbc751db req-16b3eb97-5a5e-41ff-9002-14cd9d34fa0b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.955150 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-e92e630e-1441-4312-ba9f-f369fbc751db req-16b3eb97-5a5e-41ff-9002-14cd9d34fa0b service nova] Creating event network-changed:70f67253-4c0c-45c0-9628-fba53f8172e5 for instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 on hv-cinder-82002 Sep 13 16:34:41.961360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-e92e630e-1441-4312-ba9f-f369fbc751db req-16b3eb97-5a5e-41ff-9002-14cd9d34fa0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088988 Sep 13 16:34:41.962006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1759/3507] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:42.639172 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.639804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.646116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.646595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.647054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.647736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.648185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.648608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.785002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:42.792709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1089885d-4fe9-45db-b920-a2a314cf8ae0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1361 microversion: 2.1 time: 0.157562 Sep 13 16:34:42.793280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1749/3508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:42 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:43.817605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:43.818308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:43.824535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.825023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.825465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.826926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.827382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.827808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.960131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:43.967797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d976a3ca-d5b8-4894-bab5-3ebb07295c70 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1361 microversion: 2.1 time: 0.154957 Sep 13 16:34:43.968364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1760/3509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:43 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:44.990170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.990855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.997209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.997692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.998722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.999536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.999993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.000419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.134437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:45.142334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44089817-40ec-46bc-94f3-bcf2b364080c tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1361 microversion: 2.1 time: 0.156517 Sep 13 16:34:45.142927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1750/3510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:46.165368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:46.165978 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:46.173311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.173791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.174227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.174931 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.175377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.175802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.179731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=76 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:46.302331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:46.309864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-644200b2-93f2-4ea1-81f2-29ff60359d19 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1361 microversion: 2.1 time: 0.148422 Sep 13 16:34:46.310422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1761/3511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:46 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:47.123501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ead7871a-d8ff-4bab-8c48-6b85340f9fd8 req-cd3d2a83-2c71-4734-a163-0a3fcde55461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10", "name": "network-vif-plugged", "status": "completed", "tag": "70f67253-4c0c-45c0-9628-fba53f8172e5"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:47.133186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ead7871a-d8ff-4bab-8c48-6b85340f9fd8 req-cd3d2a83-2c71-4734-a163-0a3fcde55461 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.133504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ead7871a-d8ff-4bab-8c48-6b85340f9fd8 req-cd3d2a83-2c71-4734-a163-0a3fcde55461 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.133937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ead7871a-d8ff-4bab-8c48-6b85340f9fd8 req-cd3d2a83-2c71-4734-a163-0a3fcde55461 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.145481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ead7871a-d8ff-4bab-8c48-6b85340f9fd8 req-cd3d2a83-2c71-4734-a163-0a3fcde55461 service nova] Creating event network-vif-plugged:70f67253-4c0c-45c0-9628-fba53f8172e5 for instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 on hv-cinder-82002 Sep 13 16:34:47.151407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ead7871a-d8ff-4bab-8c48-6b85340f9fd8 req-cd3d2a83-2c71-4734-a163-0a3fcde55461 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087328 Sep 13 16:34:47.151983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1751/3512] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:47.333042 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.333658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.340066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.340556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.340997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.341692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.342146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.342576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.472632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:47.480285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2a0a40b-c69d-4801-867d-f5a2f6e3c770 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1361 microversion: 2.1 time: 0.151176 Sep 13 16:34:47.480855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1762/3513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:48.505160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.505904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.512033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.512519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.512949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.513625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.514072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.514492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.644770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:48.652568 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e56f82b-2ebb-42b2-988a-00fcebb7def0 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1546 microversion: 2.1 time: 0.152063 Sep 13 16:34:48.653131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1752/3514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:48.675816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.676340 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.682676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.683190 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.683623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.684330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.684776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.685195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.761210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb1b4f5b-f2ed-42e2-a5f1-d724af07812e tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089218 Sep 13 16:34:48.761811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1763/3515] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:49.672372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f0ec2c93-5f34-46a0-bcdc-9be5ade68284 req-23958d43-a37c-41aa-9e07-635f3102580b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10", "tag": "70f67253-4c0c-45c0-9628-fba53f8172e5"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:49.677397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:49.683579 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f0ec2c93-5f34-46a0-bcdc-9be5ade68284 req-23958d43-a37c-41aa-9e07-635f3102580b service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.684135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f0ec2c93-5f34-46a0-bcdc-9be5ade68284 req-23958d43-a37c-41aa-9e07-635f3102580b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.684644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f0ec2c93-5f34-46a0-bcdc-9be5ade68284 req-23958d43-a37c-41aa-9e07-635f3102580b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.695738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f0ec2c93-5f34-46a0-bcdc-9be5ade68284 req-23958d43-a37c-41aa-9e07-635f3102580b service nova] Creating event network-changed:70f67253-4c0c-45c0-9628-fba53f8172e5 for instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 on hv-cinder-82002 Sep 13 16:34:49.701640 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f0ec2c93-5f34-46a0-bcdc-9be5ade68284 req-23958d43-a37c-41aa-9e07-635f3102580b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032349 Sep 13 16:34:49.702505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1753/3516] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:24.560276 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:24.561038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:24.564294 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:24.565079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=15 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:24.569676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:24.570161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:24.579747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.580231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.580665 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.581355 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.581801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.582219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.608373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6cabb1ff-59e5-4948-ba3c-17d5a6946c12 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10/ips" status: 200 len: 145 microversion: 2.1 time: 0.048771 Sep 13 16:35:24.608927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1764/3517] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:35:24 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:24.695729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:24.696522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=39 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:24.697600 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:36:24.697769 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 (ip 10.222.0.50) !!! Sep 13 16:36:24.703833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.704426 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:24.713671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.714174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.714591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.715316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.715773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.716201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.741755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:36:24.814834 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd9bb00a-59bf-44f0-8dc7-315126b425f8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 204 len: 0 microversion: 2.1 time: 0.120400 Sep 13 16:36:24.815667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1754/3518] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:36:24 2022] DELETE /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:36:24.822702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:24.823535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:24.828560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.829168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:24.836075 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.836559 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.836994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.837681 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.838129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.838549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.971791 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:24.979392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-330bb15e-376f-4129-b1c4-9b423c689749 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1671 microversion: 2.1 time: 0.159501 Sep 13 16:36:24.979956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1765/3519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:24 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:26.005026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:26.005672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:26.012220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.012735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.013174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.013866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.014316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.014737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.143557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:26.151187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-846524d7-5708-4828-9782-da712969edc8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1671 microversion: 2.1 time: 0.151008 Sep 13 16:36:26.151748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1755/3520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:25 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:27.022573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-844cc791-7d81-4122-a6aa-43fb45a47c15 req-d0ac41ac-401f-4307-b029-23e6a78d4e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10", "name": "network-vif-deleted", "tag": "70f67253-4c0c-45c0-9628-fba53f8172e5"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:27.033362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-844cc791-7d81-4122-a6aa-43fb45a47c15 req-d0ac41ac-401f-4307-b029-23e6a78d4e3e service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.034546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-844cc791-7d81-4122-a6aa-43fb45a47c15 req-d0ac41ac-401f-4307-b029-23e6a78d4e3e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.035080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-844cc791-7d81-4122-a6aa-43fb45a47c15 req-d0ac41ac-401f-4307-b029-23e6a78d4e3e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.052174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-844cc791-7d81-4122-a6aa-43fb45a47c15 req-d0ac41ac-401f-4307-b029-23e6a78d4e3e service nova] Creating event network-vif-deleted:70f67253-4c0c-45c0-9628-fba53f8172e5 for instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 on hv-cinder-82002 Sep 13 16:36:27.057548 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-844cc791-7d81-4122-a6aa-43fb45a47c15 req-d0ac41ac-401f-4307-b029-23e6a78d4e3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038764 Sep 13 16:36:27.062889 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1766/3521] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:27.173832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:27.174638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:27.182474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.183263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.183784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.184677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.185307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.185809 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.222764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.223374 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.223912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.224438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lazy-loading 'fault' on Instance uuid 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:27.277645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:27.285724 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7bffb96-400e-4a14-a512-6d5ace3c734d tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 200 len: 1325 microversion: 2.1 time: 0.115968 Sep 13 16:36:27.286443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1756/3522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:27 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 1325 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:28.310385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.311033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:28.317296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.317785 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.318224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.318946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.319406 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.319838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.333298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] HTTP exception thrown: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Request method failure captured: Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 HTTP/1.1 Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqplQsIy1BLJfBjqWzuq-5yAIipjbP4GvHT1cmfaJg9h2hgwpPRU1m9lq9KA560lnLdbUDgYiteK6xVoj3GTTtyxwmAfe7hnDnC23PGMYBM7LnNWAiiSZpxOIQQLEtRSu63LCkr4rjYPJLxMZcLX-MmwNAJD2qb9_r7GlnUatniHYI Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:36:28.334962 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4eb7191b18cc41de8c9c51672246991d"}]}] Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: e1cbafa1d3c244c5906e475494b39d4c Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:28.336842 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10'} Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:28.337945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:28.339746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:28.341252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Returning 404 to user: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:28.341252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ffe4054-d76a-4aab-b38a-20d7ae4826dd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 404 len: 111 microversion: 2.1 time: 0.030730 Sep 13 16:36:28.341252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1767/3523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:28 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:36:28.345803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-414237e6-1136-43a0-b8d0-014e3e98729f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '.version_select at 0x7fb67da43700>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.364996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-414237e6-1136-43a0-b8d0-014e3e98729f tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67608362" status: 202 len: 0 microversion: 2.1 time: 0.023493 Sep 13 16:36:28.365561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1757/3524] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Sep 13 16:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67608362 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:28.989112 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.989609 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:28.995573 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.996050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.996483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.997163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.997615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.998040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.011844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] HTTP exception thrown: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Request method failure captured: Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 HTTP/1.1 Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqplQsIy1BLJfBjqWzuq-5yAIipjbP4GvHT1cmfaJg9h2hgwpPRU1m9lq9KA560lnLdbUDgYiteK6xVoj3GTTtyxwmAfe7hnDnC23PGMYBM7LnNWAiiSZpxOIQQLEtRSu63LCkr4rjYPJLxMZcLX-MmwNAJD2qb9_r7GlnUatniHYI Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:36:29.013373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4eb7191b18cc41de8c9c51672246991d"}]}] Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: e1cbafa1d3c244c5906e475494b39d4c Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.015268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10'} Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:29.016322 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.018730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.020514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Returning 404 to user: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:29.020514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a0288ce-1870-4f7d-927d-17e605ba05e8 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 404 len: 111 microversion: 2.1 time: 0.029671 Sep 13 16:36:29.020514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1768/3525] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:36:28 2022] DELETE /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:36:29.023774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.024391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:29.030284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.030765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.031234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.031913 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.032363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.032818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.046424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] HTTP exception thrown: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Request method failure captured: Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 HTTP/1.1 Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKqplQsIy1BLJfBjqWzuq-5yAIipjbP4GvHT1cmfaJg9h2hgwpPRU1m9lq9KA560lnLdbUDgYiteK6xVoj3GTTtyxwmAfe7hnDnC23PGMYBM7LnNWAiiSZpxOIQQLEtRSu63LCkr4rjYPJLxMZcLX-MmwNAJD2qb9_r7GlnUatniHYI Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:36:29.048114 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4eb7191b18cc41de8c9c51672246991d"}]}] Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: e1cbafa1d3c244c5906e475494b39d4c Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.049921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10'} Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:29.050988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. Sep 13 16:36:29.052656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:36:29.054427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Returning 404 to user: Instance 4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:29.054427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f295aa44-3b67-4da1-8a91-93e3697aadfd tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10" status: 404 len: 111 microversion: 2.1 time: 0.029528 Sep 13 16:36:29.054427 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1758/3526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:29 2022] GET /compute/v2.1/servers/4371ff44-2b0e-4a36-9ca1-2b99c3a5cb10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:37:35.253442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:35.254168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=12 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:35.258447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:35.258959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:35.265491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.265969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.266401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.267902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.268404 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.268824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.299366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:35.333397 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:35.334596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:35.339018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:35.339507 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:35.347987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.348509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.349006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.349992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.350670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.351118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.391019 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:35.418953 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3963bc36-edb2-4b30-894f-c5e5b6b2776d tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 204 len: 0 microversion: 2.20 time: 0.167027 Sep 13 16:37:35.419818 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1769/3527] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Sep 13 16:37:35 2022] DELETE /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:37:35.428495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:35.429326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:35.435301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.435848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.436364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.437164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.437720 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.438200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.477743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5438920-e278-48a1-bf49-2b9f664046ca tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 204 len: 0 microversion: 2.1 time: 0.145878 Sep 13 16:37:35.478629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1759/3528] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:35 2022] DELETE /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:37:35.486826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:35.487559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:35.493613 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.494103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.494544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.495273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.495729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.496158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.627809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.635745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.637176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.638358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5d49681-a509-424a-847f-4bbccbe98348 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1723 microversion: 2.20 time: 0.213963 Sep 13 16:37:35.638991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1770/3529] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:35 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:37:35.654618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.662286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a732d7f2-4945-47e8-869e-4f0925e4e7c3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1681 microversion: 2.1 time: 0.179658 Sep 13 16:37:35.662841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1760/3530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:35 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:36.664694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:36.665407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:36.674767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.675590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.676351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.677275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.678081 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.678689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.685551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:36.686999 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:36.702622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.703847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.705083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.706006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.706801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.707476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.952789 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.955234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.963649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7947351a-a7ff-4329-9579-814c8051c238 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1613 microversion: 2.1 time: 0.282015 Sep 13 16:37:36.965433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1761/3531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:36 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1613 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:36.968713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.979098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0fd4bbe430b4a8888f3be4b23982c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859cfa45a18845f49e525ab4ed54b529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.981239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d1af231-ffda-45eb-b840-e1790155e5f8 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 200 len: 1655 microversion: 2.20 time: 0.320881 Sep 13 16:37:36.987815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1771/3532] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:36 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 1655 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:37.074823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-74b0951b-e883-4b9a-92bd-f27295ebb49f req-c794621a-f409-4163-903b-3382a4d8d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad470a6-0ff7-41e3-a0d0-887c468ce0b6", "name": "network-vif-deleted", "tag": "d002dcad-7194-4479-8406-a5f1f26495e5"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:37.089821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-74b0951b-e883-4b9a-92bd-f27295ebb49f req-c794621a-f409-4163-903b-3382a4d8d5e6 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.090303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-74b0951b-e883-4b9a-92bd-f27295ebb49f req-c794621a-f409-4163-903b-3382a4d8d5e6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.093643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-74b0951b-e883-4b9a-92bd-f27295ebb49f req-c794621a-f409-4163-903b-3382a4d8d5e6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.132895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-74b0951b-e883-4b9a-92bd-f27295ebb49f req-c794621a-f409-4163-903b-3382a4d8d5e6 service nova] Creating event network-vif-deleted:d002dcad-7194-4479-8406-a5f1f26495e5 for instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 on hv-cinder-82002 Sep 13 16:37:37.144479 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-74b0951b-e883-4b9a-92bd-f27295ebb49f req-c794621a-f409-4163-903b-3382a4d8d5e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078964 Sep 13 16:37:37.147810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1762/3533] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:37.397762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-e18b022e-31b0-4341-9fd6-c0e960a2c0ec req-a8d5e74a-b6d2-4765-b702-8c20ea657a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef222483-435a-484e-a2b3-74b22b9f281c", "name": "network-vif-deleted", "tag": "cf43def3-5087-4867-a08c-c61768216779"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:37.408426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e18b022e-31b0-4341-9fd6-c0e960a2c0ec req-a8d5e74a-b6d2-4765-b702-8c20ea657a95 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.409198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e18b022e-31b0-4341-9fd6-c0e960a2c0ec req-a8d5e74a-b6d2-4765-b702-8c20ea657a95 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.409733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e18b022e-31b0-4341-9fd6-c0e960a2c0ec req-a8d5e74a-b6d2-4765-b702-8c20ea657a95 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.424307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-e18b022e-31b0-4341-9fd6-c0e960a2c0ec req-a8d5e74a-b6d2-4765-b702-8c20ea657a95 service nova] Creating event network-vif-deleted:cf43def3-5087-4867-a08c-c61768216779 for instance ef222483-435a-484e-a2b3-74b22b9f281c on hv-cinder-82002 Sep 13 16:37:37.430102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-e18b022e-31b0-4341-9fd6-c0e960a2c0ec req-a8d5e74a-b6d2-4765-b702-8c20ea657a95 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191171 Sep 13 16:37:37.431277 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1772/3534] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:37.993642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:37.995122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:38.001883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.002509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.003161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.004646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.006002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.006450 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.050541 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.051219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.051890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.052346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lazy-loading 'fault' on Instance uuid ef222483-435a-484e-a2b3-74b22b9f281c {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:38.074916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:38.075772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:38.088969 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.089650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.090249 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.091004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.091464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.091961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.108525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:38.116905 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] HTTP exception thrown: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:37:38.118215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03442008-3164-47f0-9058-16c364fa0d5c tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 200 len: 1330 microversion: 2.1 time: 0.129472 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Request method failure captured: Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 HTTP/1.1 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqr_wzJ3QqLMnZyN4RE9Ul67qOjW9B4cekciEvaENRVAe1SfUCRQWJGfCAouEMWBuZOAOBTVPWSpTDI0UqENtGeP3PboR_fxVwPpW5981r26RH0sBM601RIF6yF_UDqAFf1ybD1bL64kJnRrniQ3E61VveIEkn08pr0Q2IiT7L5BdE Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:37:38.118571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_859cfa45a18845f49e525ab4ed54b529"}]}] Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: c0fd4bbe430b4a8888f3be4b23982c5a Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:37:38.120366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '0ad470a6-0ff7-41e3-a0d0-887c468ce0b6'} Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:38.121324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:37:38.122838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:37:38.124500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Returning 404 to user: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:38.124500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8ff05f2b-a57f-46c6-8786-c51dc26d8d48 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 404 len: 111 microversion: 2.20 time: 0.050076 Sep 13 16:37:38.124500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1773/3535] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:38 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:37:38.124881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1763/3536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:37 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:38.137765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18372c3f-1849-4be8-a8f0-b4ce7e3abebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '.version_select at 0x7fb67c3948b0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:38.142335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18372c3f-1849-4be8-a8f0-b4ce7e3abebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [5eff9ecc-cda5-45b1-b6d4-3dd1ca79e680] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:37:39.141501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:39.142252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:39.148890 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.149382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:39.149814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.150584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.151064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:39.151488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.152062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [None req-18372c3f-1849-4be8-a8f0-b4ce7e3abebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [5eff9ecc-cda5-45b1-b6d4-3dd1ca79e680] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58144. Sep 13 16:37:39.169259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c HTTP/1.1 Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:37:39.171456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:37:39.173827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'ef222483-435a-484e-a2b3-74b22b9f281c'} Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:39.174996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:37:39.180218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:37:39.182169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:39.182169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97d033a5-e936-4578-adeb-0bb901822a71 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 404 len: 111 microversion: 2.1 time: 0.035303 Sep 13 16:37:39.182169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1764/3537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:39 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:37:39.182479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18372c3f-1849-4be8-a8f0-b4ce7e3abebe tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040484790" status: 204 len: 0 microversion: 2.20 time: 1.040755 Sep 13 16:37:39.182479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1774/3538] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Sep 13 16:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040484790 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:37:39.182742 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2fda29f-9a94-4c12-9b36-78204c69cd74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '.version_select at 0x7fb67c5ebb80>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:39.202916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2fda29f-9a94-4c12-9b36-78204c69cd74 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89224440" status: 202 len: 0 microversion: 2.1 time: 0.024102 Sep 13 16:37:39.203757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1765/3539] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Sep 13 16:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89224440 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:37:39.840106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f354d4bd-69ba-40aa-bb6d-998ca6b5d6c6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: .version_select at 0x7fb67fa5e790>, body: {"keypair": {"name": "tempest-keypair-958432723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc5PAq9LUM5aWr8ZY0St5o4mpofpt+rAcwUKC18Dqy8SztUOjgNv/By6itiTrflsftPqnEe3UGU8KmZkdjEpE4sB4Zx+xDHIRj2pDCumDrvaOvIiXjLep6eo/6oAne2mw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:39.857164 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-f354d4bd-69ba-40aa-bb6d-998ca6b5d6c6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:39.861476 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-f354d4bd-69ba-40aa-bb6d-998ca6b5d6c6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:39.889751 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f354d4bd-69ba-40aa-bb6d-998ca6b5d6c6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053421 Sep 13 16:37:39.890345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1775/3540] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:37:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:41.077388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-490439436", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90fe5e9a-9ff6-4724-a98f-1f72ad00105b"}], "security_groups": [{"name": "tempest-securitygroup--1681899759"}], "key_name": "tempest-keypair-958432723", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:41.180471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] validate_networks() for [('90fe5e9a-9ff6-4724-a98f-1f72ad00105b', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:37:41.587082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:37:41.587513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:37:41.587994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:37:41.588430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:37:41.588850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:37:41.597712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.598194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.598632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.599398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.599854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.600283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.617193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:41.621169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Getting quotas for user 77c7141135ae4b8fb3c4cbc3fa153687 and project 8fab8596323c484f806904158532bb49. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:41.632598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:37:41.634841 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:37:41.683935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-392f93a6-c234-41d1-9b91-9b2e2fe3e08a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611309 Sep 13 16:37:41.684566 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1766/3541] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:37:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:37:41.696239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-397c729a-3391-40c1-8fd0-68582046b3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:41.696954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-397c729a-3391-40c1-8fd0-68582046b3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:41.752029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-397c729a-3391-40c1-8fd0-68582046b3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:41.758877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-397c729a-3391-40c1-8fd0-68582046b3d6 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1240 microversion: 2.1 time: 0.066413 Sep 13 16:37:41.759501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1776/3542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:41 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:42.783951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:42.784512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:42.791292 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.791780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.792222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.793153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.793645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.794112 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.862474 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:42.870635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03400a3b-a492-4daf-81fd-dd2c87acfa2d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1300 microversion: 2.1 time: 0.091848 Sep 13 16:37:42.871490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1767/3543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:42 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:43.894259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:43.894855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:43.901738 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.902211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.902641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.903352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.903804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.904224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:44.033351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:44.041713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3fa24fcf-9ea5-4499-8664-c66fef639bee tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.151460 Sep 13 16:37:44.049203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1777/3544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:43 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:44.265430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f2b05d1d-a81f-4057-a70d-7e8cee702f0e req-bad64c8a-17a3-4553-b78d-c0c0c3e38aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1d5242-2209-4fed-bcd9-f7986bc8aeac", "tag": "9d16c7e2-908d-4013-a39d-dbff071e3d23"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:44.277005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2b05d1d-a81f-4057-a70d-7e8cee702f0e req-bad64c8a-17a3-4553-b78d-c0c0c3e38aa7 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:44.277580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2b05d1d-a81f-4057-a70d-7e8cee702f0e req-bad64c8a-17a3-4553-b78d-c0c0c3e38aa7 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:44.278029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2b05d1d-a81f-4057-a70d-7e8cee702f0e req-bad64c8a-17a3-4553-b78d-c0c0c3e38aa7 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:44.292208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f2b05d1d-a81f-4057-a70d-7e8cee702f0e req-bad64c8a-17a3-4553-b78d-c0c0c3e38aa7 service nova] Creating event network-changed:9d16c7e2-908d-4013-a39d-dbff071e3d23 for instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac on hv-cinder-82002 Sep 13 16:37:44.297981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f2b05d1d-a81f-4057-a70d-7e8cee702f0e req-bad64c8a-17a3-4553-b78d-c0c0c3e38aa7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Sep 13 16:37:44.298258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1768/3545] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:45.066680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:45.067323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:45.073746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.074229 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.074671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.075391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.075845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.076271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.253094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:45.260766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e82c23e5-537b-4c59-b0de-fc125552ed67 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.199333 Sep 13 16:37:45.261328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1778/3546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:45 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:46.284372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:46.284936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:46.291556 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.292047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.292487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.293171 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.293622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.294047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.476234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:46.483850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6fcdd376-6794-451b-a41f-2490c3189373 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.204464 Sep 13 16:37:46.484413 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1769/3547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:46 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:47.507825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:47.508425 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:47.515128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.515600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.516027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.516702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.517146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.518027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.644809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:47.652309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a0b4277-8fbb-4ad8-a16a-d31f253725f3 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.148298 Sep 13 16:37:47.652872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1779/3548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:47 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:48.677062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:48.677672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:48.684145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.684630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.685075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.685762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.686218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.686649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.816250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:48.823833 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e47e01d9-0c9a-4efd-9a49-21b82a610634 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.151424 Sep 13 16:37:48.824391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1770/3549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:48 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:49.847909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:49.848514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:49.855102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.855585 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.856024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.856711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.857193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.857615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.985534 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:49.993880 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a69ffb0-394d-4387-bb00-3e278541145d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.150490 Sep 13 16:37:49.994668 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1780/3550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:49 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:50.095466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-afcd27db-968f-4bc7-a198-62bcb58cdce5 req-762eac45-196e-4167-958e-5a09cc13bc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1d5242-2209-4fed-bcd9-f7986bc8aeac", "name": "network-vif-plugged", "status": "completed", "tag": "9d16c7e2-908d-4013-a39d-dbff071e3d23"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:50.107120 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-afcd27db-968f-4bc7-a198-62bcb58cdce5 req-762eac45-196e-4167-958e-5a09cc13bc27 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.107610 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-afcd27db-968f-4bc7-a198-62bcb58cdce5 req-762eac45-196e-4167-958e-5a09cc13bc27 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.108646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-afcd27db-968f-4bc7-a198-62bcb58cdce5 req-762eac45-196e-4167-958e-5a09cc13bc27 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.119906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-afcd27db-968f-4bc7-a198-62bcb58cdce5 req-762eac45-196e-4167-958e-5a09cc13bc27 service nova] Creating event network-vif-plugged:9d16c7e2-908d-4013-a39d-dbff071e3d23 for instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac on hv-cinder-82002 Sep 13 16:37:50.125057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-afcd27db-968f-4bc7-a198-62bcb58cdce5 req-762eac45-196e-4167-958e-5a09cc13bc27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 Sep 13 16:37:50.125926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1771/3551] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:51.017557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:51.018347 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:51.024685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.025162 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.025601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.026281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.026732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.027192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.160615 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:51.168163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf120af7-e882-4ca4-a469-3308be0333a0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1366 microversion: 2.1 time: 0.154459 Sep 13 16:37:51.168733 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1781/3552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:51 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:52.192534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:52.193241 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:52.195671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:52.196456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:52.202574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.203158 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.203869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.204563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.205016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.205441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.333481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:52.340977 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8b71771-074d-4253-b020-510cfa2c16c0 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1556 microversion: 2.1 time: 0.153202 Sep 13 16:37:52.341533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1772/3553] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:52 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:52.363359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:52.363875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:52.365772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:52.371623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.372085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.372557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.373236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.373683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.374113 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.451657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a2aab2b-ff03-49ad-855c-ce54fe2c13b1 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092161 Sep 13 16:37:52.452258 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1782/3554] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Sep 13 16:37:52 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:53.364087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-68ce9d12-4f27-4778-993e-d585c59f11d6 req-ea620575-602d-40ec-82a9-96be64b35cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1d5242-2209-4fed-bcd9-f7986bc8aeac", "tag": "9d16c7e2-908d-4013-a39d-dbff071e3d23"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:53.373762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68ce9d12-4f27-4778-993e-d585c59f11d6 req-ea620575-602d-40ec-82a9-96be64b35cdc service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.374306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68ce9d12-4f27-4778-993e-d585c59f11d6 req-ea620575-602d-40ec-82a9-96be64b35cdc service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.374803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68ce9d12-4f27-4778-993e-d585c59f11d6 req-ea620575-602d-40ec-82a9-96be64b35cdc service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.389443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-68ce9d12-4f27-4778-993e-d585c59f11d6 req-ea620575-602d-40ec-82a9-96be64b35cdc service nova] Creating event network-changed:9d16c7e2-908d-4013-a39d-dbff071e3d23 for instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac on hv-cinder-82002 Sep 13 16:37:53.396020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-68ce9d12-4f27-4778-993e-d585c59f11d6 req-ea620575-602d-40ec-82a9-96be64b35cdc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036486 Sep 13 16:37:53.396699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1773/3555] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:25.397146 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:25.397973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:25.399089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:38:25.399233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:38:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac/ips (ip 10.222.0.50) !!! Sep 13 16:38:25.405133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:25.405624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:25.416034 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:25.416506 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:25.416934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:25.417612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:25.418056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:25.418473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:25.443704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-682e6a42-094b-421d-89cb-2ad1e7016427 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac/ips" status: 200 len: 149 microversion: 2.1 time: 0.047872 Sep 13 16:38:25.444272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1783/3556] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:38:25 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:25.518058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:25.518814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:25.524289 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:25.524876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:25.533055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.533875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.534654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.535904 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.536766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.537576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.567616 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:39:25.641956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ceaf1064-37d5-4773-a80e-fa2f8397442e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 204 len: 0 microversion: 2.1 time: 0.125806 Sep 13 16:39:25.644346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1774/3557] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:39:25 2022] DELETE /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:39:25.652407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:25.653139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:25.655135 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:25.655778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:25.661572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.662057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.662502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.663217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.663685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.664099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.792705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.800400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c374939-24e0-4017-892e-0b4414571afa tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1680 microversion: 2.1 time: 0.153506 Sep 13 16:39:25.800964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1784/3558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:25 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:26.824864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:26.825572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:26.832472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.832946 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.833404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.834116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.834560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.835010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.966549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:26.974213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-048b3ca9-cf77-41f5-997d-cf85f4a6b5cc tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1680 microversion: 2.1 time: 0.153705 Sep 13 16:39:26.974951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1775/3559] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:26 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:27.775844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-b03c4511-624c-4fe2-baf7-92149f289d5f req-17053f5b-ee78-4ae0-8f4f-6efcd011e308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1d5242-2209-4fed-bcd9-f7986bc8aeac", "name": "network-vif-deleted", "tag": "9d16c7e2-908d-4013-a39d-dbff071e3d23"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:27.786675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b03c4511-624c-4fe2-baf7-92149f289d5f req-17053f5b-ee78-4ae0-8f4f-6efcd011e308 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.787197 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b03c4511-624c-4fe2-baf7-92149f289d5f req-17053f5b-ee78-4ae0-8f4f-6efcd011e308 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.787636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b03c4511-624c-4fe2-baf7-92149f289d5f req-17053f5b-ee78-4ae0-8f4f-6efcd011e308 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.799850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-b03c4511-624c-4fe2-baf7-92149f289d5f req-17053f5b-ee78-4ae0-8f4f-6efcd011e308 service nova] Creating event network-vif-deleted:9d16c7e2-908d-4013-a39d-dbff071e3d23 for instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac on hv-cinder-82002 Sep 13 16:39:27.805184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-b03c4511-624c-4fe2-baf7-92149f289d5f req-17053f5b-ee78-4ae0-8f4f-6efcd011e308 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033560 Sep 13 16:39:27.805779 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1785/3560] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:27.999956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:28.001278 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:28.008000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.008795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.009605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:28.011167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.011598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.012023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:28.047335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.047821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.048259 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:28.048718 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lazy-loading 'fault' on Instance uuid ce1d5242-2209-4fed-bcd9-f7986bc8aeac {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:28.089717 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:28.097527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05eb9893-b1de-4a46-9778-3c429bf45b0d tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 200 len: 1330 microversion: 2.1 time: 0.102545 Sep 13 16:39:28.098260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1776/3561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:27 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:29.122591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:29.123299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:29.129661 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.130148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.130591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.131319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.131775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.132203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.146082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac HTTP/1.1 Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:39:29.147722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:29.149606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ce1d5242-2209-4fed-bcd9-f7986bc8aeac'} Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:29.150657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:29.152627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:29.154731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:29.154731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9bb2dbf5-2d3d-4406-8969-ef8bc0a47a52 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 404 len: 111 microversion: 2.1 time: 0.031792 Sep 13 16:39:29.154731 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1786/3562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:29 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:29.158012 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-924d7da1-6332-4900-bce1-c29b1d309711 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '.version_select at 0x7fb67faf00d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:29.176683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-924d7da1-6332-4900-bce1-c29b1d309711 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958432723" status: 202 len: 0 microversion: 2.1 time: 0.022566 Sep 13 16:39:29.177230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1777/3563] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Sep 13 16:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958432723 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:30.038218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:30.038712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:30.045801 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:30.046283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:30.046709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:30.047418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:30.047864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:30.048285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:30.062535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac HTTP/1.1 Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:39:30.064095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.066006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ce1d5242-2209-4fed-bcd9-f7986bc8aeac'} Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:30.067702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.069560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.071318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:30.071318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3cdb851-739c-408c-8409-f287c4ec94dd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 404 len: 111 microversion: 2.1 time: 0.031103 Sep 13 16:39:30.071318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1787/3564] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:39:30 2022] DELETE /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:30.074281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:30.074921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ce1d5242-2209-4fed-bcd9-f7986bc8aeac] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:30.081151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:30.081637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:30.082081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:30.082770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:30.083256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:30.083694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:30.096865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac HTTP/1.1 Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:39:30.098522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.100329 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'ce1d5242-2209-4fed-bcd9-f7986bc8aeac'} Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:30.101301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. Sep 13 16:39:30.102966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:39:30.104436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance ce1d5242-2209-4fed-bcd9-f7986bc8aeac could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:30.104436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85a78628-67bf-45d9-825c-a0cfd5657071 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac" status: 404 len: 111 microversion: 2.1 time: 0.029862 Sep 13 16:39:30.104436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1778/3565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:30 2022] GET /compute/v2.1/servers/ce1d5242-2209-4fed-bcd9-f7986bc8aeac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:32.792198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:32.792955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=12 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:32.793967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:41:32.794129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc (ip 10.222.0.50) !!! Sep 13 16:41:32.796985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 16:41:32.797108 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc (ip 10.222.0.50) !!! Sep 13 16:41:32.803808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:32.804469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:32.832015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:32.832959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:32.833461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:32.834458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:32.835316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:32.835759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:32.865538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:32.977851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e507719-6d26-4f54-9c49-f861433292cb tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 204 len: 0 microversion: 2.1 time: 0.187524 Sep 13 16:41:32.978421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1788/3566] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:32 2022] DELETE /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:32.991767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8c5ed24-4dec-497c-baf4-25bdbe03a96d] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 16:41:32.992699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:32.993436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:32.995079 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:41:32.995436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc (ip 10.222.0.50) !!! Sep 13 16:41:32.999817 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:33.000435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:33.010175 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.010661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.011133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.011832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.012291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.012755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.177882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:33.186023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56c1ea40-d49d-4bfd-aec8-c16b5a6de36b tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1506 microversion: 2.1 time: 0.202986 Sep 13 16:41:33.186590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1779/3567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:32 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:33.927616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:33.928198 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:33.935311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.935802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.936243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.936936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.937391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.937820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.967492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:34.019129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.020695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.033319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.034396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.035343 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.037040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.037686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.038310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.054810 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8c5ed24-4dec-497c-baf4-25bdbe03a96d] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58396. Sep 13 16:41:34.056884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c HTTP/1.1 Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:41:34.058681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.059825 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'ef222483-435a-484e-a2b3-74b22b9f281c'} Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:34.060428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.061540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.064203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6fa0102-cfd6-4970-94a9-b614df759c9a tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "DELETE /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 204 len: 0 microversion: 2.1 time: 0.140668 Sep 13 16:41:34.065307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:34.066366 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-027466f8-d4d6-4edb-a232-8a232de6e653 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 404 len: 111 microversion: 2.1 time: 0.052652 Sep 13 16:41:34.067303 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1780/3569] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:34 2022] DELETE /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:34.069091 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1789/3569] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:33 2022] DELETE /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:34.076830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.077696 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.078094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.079236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: ef222483-435a-484e-a2b3-74b22b9f281c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.085363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.086103 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.086730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.087695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.088163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.088272 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.088697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.089227 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.089584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.090023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.090653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.091385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.107168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c HTTP/1.1 Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:41:34.108843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.110230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ef222483-435a-484e-a2b3-74b22b9f281c'} Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:34.111047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. Sep 13 16:41:34.112238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.113085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance ef222483-435a-484e-a2b3-74b22b9f281c could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:34.113085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05e97841-5f6d-4876-a25c-8db51efda54e tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c" status: 404 len: 111 microversion: 2.1 time: 0.037047 Sep 13 16:41:34.114148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1790/3570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:34 2022] GET /compute/v2.1/servers/ef222483-435a-484e-a2b3-74b22b9f281c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:34.121916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.122416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.140692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.141188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.141624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.142318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.142944 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.143645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.143840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.144567 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.145269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.145472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lazy-loading 'fault' on Instance uuid de8c6aa1-3270-40d0-88f2-196f26018b5c {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:34.168538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 HTTP/1.1 Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:41:34.170204 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.171338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '8f346b6b-2791-48f9-be20-2c8defa26b50'} Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:34.172114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.173027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.175025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:34.175025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9fe7a5c8-852d-42c3-9558-d199df3bdeed tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 404 len: 111 microversion: 2.1 time: 0.057226 Sep 13 16:41:34.175025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1791/3571] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:34 2022] DELETE /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:34.181024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.181646 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 8f346b6b-2791-48f9-be20-2c8defa26b50] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.188136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.188675 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.189123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.190371 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.190883 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.191375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.207804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 HTTP/1.1 Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:41:34.209486 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.210549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '8f346b6b-2791-48f9-be20-2c8defa26b50'} Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:34.211184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. Sep 13 16:41:34.212104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:34.213712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance 8f346b6b-2791-48f9-be20-2c8defa26b50 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:34.213712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ae9d07b-5e03-439d-b4f5-df256cb66d16 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50" status: 404 len: 111 microversion: 2.1 time: 0.033709 Sep 13 16:41:34.213712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1792/3572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:34 2022] GET /compute/v2.1/servers/8f346b6b-2791-48f9-be20-2c8defa26b50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:41:34.217060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.218052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.224704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.225195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.225693 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.226414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.226976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.227346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.262837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1cbafa1d3c244c5906e475494b39d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7191b18cc41de8c9c51672246991d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:34.286866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-073a80a6-9295-4f48-8e7a-83b640f7b614 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 200 len: 1469 microversion: 2.1 time: 0.212416 Sep 13 16:41:34.287534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1781/3573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:34 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:34.538551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-d399a3cb-4c08-43a2-a6fe-34b85e1b2a3b req-f4dc1eba-7c2e-483b-ac3e-3d2390458080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36aa2e1-0b94-432d-b901-f13533f560fc", "name": "network-vif-deleted", "tag": "769d079d-52e4-4b48-93b1-23e2ef23bcb9"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:34.553299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d399a3cb-4c08-43a2-a6fe-34b85e1b2a3b req-f4dc1eba-7c2e-483b-ac3e-3d2390458080 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.554721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d399a3cb-4c08-43a2-a6fe-34b85e1b2a3b req-f4dc1eba-7c2e-483b-ac3e-3d2390458080 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.555624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d399a3cb-4c08-43a2-a6fe-34b85e1b2a3b req-f4dc1eba-7c2e-483b-ac3e-3d2390458080 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.575665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-d399a3cb-4c08-43a2-a6fe-34b85e1b2a3b req-f4dc1eba-7c2e-483b-ac3e-3d2390458080 service nova] Creating event network-vif-deleted:769d079d-52e4-4b48-93b1-23e2ef23bcb9 for instance a36aa2e1-0b94-432d-b901-f13533f560fc on hv-cinder-82002 Sep 13 16:41:34.586364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-d399a3cb-4c08-43a2-a6fe-34b85e1b2a3b req-f4dc1eba-7c2e-483b-ac3e-3d2390458080 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051226 Sep 13 16:41:34.593248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1782/3574] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:34.605189 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:34.618095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66c30112-5616-4abe-a905-118f6e8d6cee tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1506 microversion: 2.1 time: 0.404920 Sep 13 16:41:34.619469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1793/3575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:34 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:34.970733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ec448568-6deb-4e0c-bd2a-cd3b9f778d56 req-0b3bfa62-7e52-4e51-bbcb-e33950533a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd", "name": "network-vif-deleted", "tag": "8fcbe249-d838-4fbc-aa36-0e83ddfe0aab"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:34.980681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ec448568-6deb-4e0c-bd2a-cd3b9f778d56 req-0b3bfa62-7e52-4e51-bbcb-e33950533a18 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.981166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ec448568-6deb-4e0c-bd2a-cd3b9f778d56 req-0b3bfa62-7e52-4e51-bbcb-e33950533a18 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.981599 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ec448568-6deb-4e0c-bd2a-cd3b9f778d56 req-0b3bfa62-7e52-4e51-bbcb-e33950533a18 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.994588 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ec448568-6deb-4e0c-bd2a-cd3b9f778d56 req-0b3bfa62-7e52-4e51-bbcb-e33950533a18 service nova] Creating event network-vif-deleted:8fcbe249-d838-4fbc-aa36-0e83ddfe0aab for instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd on hv-cinder-82002 Sep 13 16:41:34.999723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ec448568-6deb-4e0c-bd2a-cd3b9f778d56 req-0b3bfa62-7e52-4e51-bbcb-e33950533a18 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092083 Sep 13 16:41:35.000312 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1783/3576] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:35.310767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:35.312364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] [instance: de8c6aa1-3270-40d0-88f2-196f26018b5c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:35.348964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.351772 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.352363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.353210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.359330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.360676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.411139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] HTTP exception thrown: Instance de8c6aa1-3270-40d0-88f2-196f26018b5c could not be found. Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Request method failure captured: Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c HTTP/1.1 Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqplQsIy1BLJfBjqWzuq-5yAIipjbP4GvHT1cmfaJg9h2hgwpPRU1m9lq9KA560lnLdbUDgYiteK6xVoj3GTTtyxwmAfe7hnDnC23PGMYBM7LnNWAiiSZpxOIQQLEtRSu63LCkr4rjYPJLxMZcLX-MmwNAJD2qb9_r7GlnUatniHYI Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:41:35.412936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb7191b18cc41de8c9c51672246991d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4eb7191b18cc41de8c9c51672246991d"}]}] Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 4eb7191b18cc41de8c9c51672246991d Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1992519494 Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: e1cbafa1d3c244c5906e475494b39d4c Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-1992519494-project Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance de8c6aa1-3270-40d0-88f2-196f26018b5c could not be found. Sep 13 16:41:35.414202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'de8c6aa1-3270-40d0-88f2-196f26018b5c'} Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de8c6aa1-3270-40d0-88f2-196f26018b5c could not be found. Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:35.415008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8c6aa1-3270-40d0-88f2-196f26018b5c could not be found. Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8c6aa1-3270-40d0-88f2-196f26018b5c could not be found. Sep 13 16:41:35.416134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:35.417218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] Returning 404 to user: Instance de8c6aa1-3270-40d0-88f2-196f26018b5c could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:35.417218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-591faf44-debf-4860-bf54-545001c5a656 tempest-AttachVolumeTestJSON-1992519494 tempest-AttachVolumeTestJSON-1992519494-project] 10.222.0.50 "GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c" status: 404 len: 111 microversion: 2.1 time: 0.108507 Sep 13 16:41:35.417218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1794/3577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:35 2022] GET /compute/v2.1/servers/de8c6aa1-3270-40d0-88f2-196f26018b5c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:35.442327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:35.443821 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:35.459779 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.460976 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.461879 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.463891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.468313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.468887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.534555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:35.650196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:35.650827 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:35.651134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9741b3d-b544-4880-90fb-17d1ab92bfbd tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 204 len: 0 microversion: 2.1 time: 0.215671 Sep 13 16:41:35.651836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1784/3578] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:35 2022] DELETE /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:41:35.662362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.662577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:35.662920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.663381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.663544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:35.664131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.664591 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.671465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.671903 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.673253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.674521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.675521 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.676199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.676849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.720408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.721483 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.722007 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.722555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lazy-loading 'fault' on Instance uuid a36aa2e1-0b94-432d-b901-f13533f560fc {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:35.727528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.728002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.728432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.728877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lazy-loading 'fault' on Instance uuid 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:35.784316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:35.795477 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c534755c-918c-4c59-a0b8-c1f4122d72d6 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 200 len: 1312 microversion: 2.1 time: 0.151612 Sep 13 16:41:35.796352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1795/3579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:35 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:35.803361 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c7141135ae4b8fb3c4cbc3fa153687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab8596323c484f806904158532bb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:35.819388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b318e13-8586-4388-8370-35a4d55a6e7a tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 200 len: 1337 microversion: 2.1 time: 0.162469 Sep 13 16:41:35.820156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1785/3580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:35 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 1337 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:36.637724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-524602d5-4616-432b-b45d-9bfa7db707f3 req-8f24490f-03d2-45eb-b194-817cc19b8728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8e8d08-fc78-4837-8f60-1ba9a1855c8f", "name": "network-vif-deleted", "tag": "dacf04c3-1db7-4acf-8a65-7c3665c504a0"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:36.709901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-524602d5-4616-432b-b45d-9bfa7db707f3 req-8f24490f-03d2-45eb-b194-817cc19b8728 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.711537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-524602d5-4616-432b-b45d-9bfa7db707f3 req-8f24490f-03d2-45eb-b194-817cc19b8728 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.712804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-524602d5-4616-432b-b45d-9bfa7db707f3 req-8f24490f-03d2-45eb-b194-817cc19b8728 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.737781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-524602d5-4616-432b-b45d-9bfa7db707f3 req-8f24490f-03d2-45eb-b194-817cc19b8728 service nova] Creating event network-vif-deleted:dacf04c3-1db7-4acf-8a65-7c3665c504a0 for instance 7a8e8d08-fc78-4837-8f60-1ba9a1855c8f on hv-cinder-82002 Sep 13 16:41:36.744231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-524602d5-4616-432b-b45d-9bfa7db707f3 req-8f24490f-03d2-45eb-b194-817cc19b8728 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112215 Sep 13 16:41:36.745008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1796/3581] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:36.823846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.824683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: a36aa2e1-0b94-432d-b901-f13533f560fc] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.831582 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.832059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.832494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.833253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.834029 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.834792 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.846855 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.848041 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] [instance: 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.852796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] HTTP exception thrown: Instance a36aa2e1-0b94-432d-b901-f13533f560fc could not be found. Sep 13 16:41:36.854734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.855352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Request method failure captured: Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc HTTP/1.1 Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKquW9FPzA91u_gO_OM_eeWoJaatE8b1iQ9x6o0TlAVBkMLDN6sWT_dRsTvpAp68FOuTvOEzmkhGiaaEqsBPwk_NbYkfBtEhI6xZRktvSgflCo6rs1tuTtY9mKEZ7t464omn-EQ-AK4F3_bvEXAA2Ba179oSmmRIlA2FeEZGmMqMbDo Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:41:36.855683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b11b198b8754bcabf244e0047475b8d"}]}] Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 6d31b2ec391441f7bab3546d2354b0a1 Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance a36aa2e1-0b94-432d-b901-f13533f560fc could not be found. Sep 13 16:41:36.856878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'a36aa2e1-0b94-432d-b901-f13533f560fc'} Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36aa2e1-0b94-432d-b901-f13533f560fc could not be found. Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:36.857496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36aa2e1-0b94-432d-b901-f13533f560fc could not be found. Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36aa2e1-0b94-432d-b901-f13533f560fc could not be found. Sep 13 16:41:36.858419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.859358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.859358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.859358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.859358 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.866368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Returning 404 to user: Instance a36aa2e1-0b94-432d-b901-f13533f560fc could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:36.869020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c3325c3-1540-4f59-8626-0e312444653e tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc" status: 404 len: 111 microversion: 2.1 time: 0.049121 Sep 13 16:41:36.869649 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1786/3582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/servers/a36aa2e1-0b94-432d-b901-f13533f560fc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:36.878160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.878650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.879708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] HTTP exception thrown: Instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd could not be found. Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Request method failure captured: Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd HTTP/1.1 Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKsL4k-dXDn7x9dFVjR-GoqoHFHRoBN0aaL6cPBj58tOAxUOnN52ddiwN5v2eM1AgxRMNQU-yylH91JMPnxeEXo1_g4YuzZQuWfoY4pznA0R-ykt1r-zZxEUjihraGqcvXWogXa14P1lWl_o4GcaenGOAEp2I4HacUmZF7EOOQ_6tGY Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:41:36.882990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fab8596323c484f806904158532bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fab8596323c484f806904158532bb49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fab8596323c484f806904158532bb49"}]}] Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8fab8596323c484f806904158532bb49 Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179311243 Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 77c7141135ae4b8fb3c4cbc3fa153687 Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-179311243-project Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd could not be found. Sep 13 16:41:36.884065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd'} Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd could not be found. Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:36.884645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd could not be found. Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd could not be found. Sep 13 16:41:36.885682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:36.886522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] Returning 404 to user: Instance 6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:36.886522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b20f1e7-fd9d-4337-84b9-6fa1d607e1e4 tempest-AttachVolumeNegativeTest-179311243 tempest-AttachVolumeNegativeTest-179311243-project] 10.222.0.50 "GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd" status: 404 len: 111 microversion: 2.1 time: 0.043160 Sep 13 16:41:36.886670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.886744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1797/3583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/servers/6e5e4ffa-d14e-4e6a-af81-6c97f8ee2bbd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:36.889739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.890212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.890971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.891430 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.891863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.921727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:37.035786 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf74ca9a-f417-439c-892f-ace17f834a4a tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 204 len: 0 microversion: 2.1 time: 0.161044 Sep 13 16:41:37.037091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1787/3584] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:36 2022] DELETE /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:41:37.052057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:37.052817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:37.063375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:37.066778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:37.067648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:37.069095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:37.071141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:37.071708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:37.444484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:37.454314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab51fd0f-3179-4910-8972-e97e30bff987 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.408938 Sep 13 16:41:37.455493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1798/3585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:37 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:38.478869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:38.480331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:38.488166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.488992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.489667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.490584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.491263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.491914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.762723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-8e834971-7507-4e0b-8a8e-f3f7c6d213fd req-8e32fb22-51c9-4105-9666-8ed49499b995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325211a3-a74a-48fb-b693-e9340461ed2d", "name": "network-vif-deleted", "tag": "fe971ca6-2183-4fd6-8985-8d2e9bae7e50"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:38.774539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-8e834971-7507-4e0b-8a8e-f3f7c6d213fd req-8e32fb22-51c9-4105-9666-8ed49499b995 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.775246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-8e834971-7507-4e0b-8a8e-f3f7c6d213fd req-8e32fb22-51c9-4105-9666-8ed49499b995 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.775899 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-8e834971-7507-4e0b-8a8e-f3f7c6d213fd req-8e32fb22-51c9-4105-9666-8ed49499b995 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.788193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-8e834971-7507-4e0b-8a8e-f3f7c6d213fd req-8e32fb22-51c9-4105-9666-8ed49499b995 service nova] Creating event network-vif-deleted:fe971ca6-2183-4fd6-8985-8d2e9bae7e50 for instance 325211a3-a74a-48fb-b693-e9340461ed2d on hv-cinder-82002 Sep 13 16:41:38.793488 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-8e834971-7507-4e0b-8a8e-f3f7c6d213fd req-8e32fb22-51c9-4105-9666-8ed49499b995 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Sep 13 16:41:38.794173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1799/3586] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:41:38.851244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d31b2ec391441f7bab3546d2354b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11b198b8754bcabf244e0047475b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.858534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ccf7084f-c4d0-4176-8209-15d029a447e1 tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 200 len: 1520 microversion: 2.1 time: 0.384492 Sep 13 16:41:38.860179 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1788/3587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:38 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:39.883290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:39.883996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] [instance: 6bf15226-4335-4045-96dc-a7e5fb7e72d1] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:39.897236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.901509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.902033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.902777 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.903307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.903746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.937756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] HTTP exception thrown: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 could not be found. Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Request method failure captured: Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 HTTP/1.1 Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKquW9FPzA91u_gO_OM_eeWoJaatE8b1iQ9x6o0TlAVBkMLDN6sWT_dRsTvpAp68FOuTvOEzmkhGiaaEqsBPwk_NbYkfBtEhI6xZRktvSgflCo6rs1tuTtY9mKEZ7t464omn-EQ-AK4F3_bvEXAA2Ba179oSmmRIlA2FeEZGmMqMbDo Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:41:39.942680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b11b198b8754bcabf244e0047475b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b11b198b8754bcabf244e0047475b8d"}]}] Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 5b11b198b8754bcabf244e0047475b8d Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254371699 Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 6d31b2ec391441f7bab3546d2354b0a1 Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254371699-project Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 could not be found. Sep 13 16:41:39.944025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '6bf15226-4335-4045-96dc-a7e5fb7e72d1'} Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 could not be found. Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:39.945073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 could not be found. Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 could not be found. Sep 13 16:41:39.946217 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:41:39.947087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] Returning 404 to user: Instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:39.947087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5483c6e4-b493-4d60-ae5f-d4be575399ae tempest-ServerRescueNegativeTestJSON-254371699 tempest-ServerRescueNegativeTestJSON-254371699-project] 10.222.0.50 "GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1" status: 404 len: 111 microversion: 2.1 time: 0.065206 Sep 13 16:41:39.947087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1800/3588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:39 2022] GET /compute/v2.1/servers/6bf15226-4335-4045-96dc-a7e5fb7e72d1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:41.140269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2862e430-4278-42bf-bcad-f0cad35b2305 req-30e01f40-5ebe-45d0-87c9-f82a4dd3b4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf15226-4335-4045-96dc-a7e5fb7e72d1", "name": "network-vif-deleted", "tag": "435cf4a9-bc40-4136-b685-76af6271637a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:41.164532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2862e430-4278-42bf-bcad-f0cad35b2305 req-30e01f40-5ebe-45d0-87c9-f82a4dd3b4c2 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.165340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2862e430-4278-42bf-bcad-f0cad35b2305 req-30e01f40-5ebe-45d0-87c9-f82a4dd3b4c2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.167263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2862e430-4278-42bf-bcad-f0cad35b2305 req-30e01f40-5ebe-45d0-87c9-f82a4dd3b4c2 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.193389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2862e430-4278-42bf-bcad-f0cad35b2305 req-30e01f40-5ebe-45d0-87c9-f82a4dd3b4c2 service nova] Creating event network-vif-deleted:435cf4a9-bc40-4136-b685-76af6271637a for instance 6bf15226-4335-4045-96dc-a7e5fb7e72d1 on hv-cinder-82002 Sep 13 16:41:41.216589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2862e430-4278-42bf-bcad-f0cad35b2305 req-30e01f40-5ebe-45d0-87c9-f82a4dd3b4c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079962 Sep 13 16:41:41.221302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1789/3589] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:56.317679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:56.318410 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:56.489393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f81dabe4-8634-446e-820c-402ec5642d66 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Action: 'create', calling method: .version_select at 0x7fb67c110af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-971711683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjO7K75ddda58X27jCKOqXlstHXilo46+1MbZrcZcdy7GFWRrH337HMENG3bcuIiVdLGx1PyL410QYlWY1FwV/DxZ+tCUCWuUSA5HLH32VoHKtyKsiXtKsYBx8JdJx/kA=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:56.506287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-f81dabe4-8634-446e-820c-402ec5642d66 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for project 02ef20a5c40945c688b9343861cadb85. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:41:56.510375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-f81dabe4-8634-446e-820c-402ec5642d66 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for user b6417e189b0d467480627cfd38331a9f and project 02ef20a5c40945c688b9343861cadb85. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:41:56.538353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f81dabe4-8634-446e-820c-402ec5642d66 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.226586 Sep 13 16:41:56.539213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1801/3590] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:41:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:15.245549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-23293075", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971711683", "security_groups": [{"name": "tempest-secgroup-smoke-1865310243"}], "block_device_mapping_v2": [{"uuid": "25862efd-49c9-4f3c-8942-543371e7f8cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4ea24ff-eba9-4b1b-b236-b6ed3f3d50d9"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:15.269483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:15.270668 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:15.408456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] validate_networks() for [('a4ea24ff-eba9-4b1b-b236-b6ed3f3d50d9', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:42:15.870389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:42:15.870811 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:42:15.871353 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:42:15.871762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:42:15.872169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:42:15.881755 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.882252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.882801 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.883504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.883955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.884559 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.901178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for project 02ef20a5c40945c688b9343861cadb85. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:15.905325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for user b6417e189b0d467480627cfd38331a9f and project 02ef20a5c40945c688b9343861cadb85. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:15.967694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:42:15.970631 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25862efd-49c9-4f3c-8942-543371e7f8cf',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:42:16.112087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-adeb0870-f459-4829-b93a-bd615ee59f29 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.870741 Sep 13 16:42:16.112859 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1790/3591] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:42:16.121264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:16.122011 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:16.126605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a46f55b-9f4d-4aa4-a616-b6e759d126fa tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.127234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a46f55b-9f4d-4aa4-a616-b6e759d126fa tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.210381 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a46f55b-9f4d-4aa4-a616-b6e759d126fa tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.221540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a46f55b-9f4d-4aa4-a616-b6e759d126fa tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1092 microversion: 2.1 time: 0.100683 Sep 13 16:42:16.222475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1802/3592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1092 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:17.245933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:17.246738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:17.254704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:17.255208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:17.255646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.256333 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:17.256783 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:17.257213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.320253 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:17.328066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15cdf28a-f083-4d32-ad64-860f633637ec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1142 microversion: 2.1 time: 0.086350 Sep 13 16:42:17.329325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1791/3593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:17 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1142 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:18.352181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:18.353586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:18.361813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.362314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.362759 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.363509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.363971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.364424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.747844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:18.761174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0d19e09-9cb2-4d5d-a61a-aa12515503f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1142 microversion: 2.1 time: 0.413054 Sep 13 16:42:18.762181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1803/3594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:18 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1142 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:19.787645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:19.788416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:19.795052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.795530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.795965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.796745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.797943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.798637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.869637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:19.876651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c1c91aa-e92b-494e-8ad5-24b9f9f85edf tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1190 microversion: 2.1 time: 0.092983 Sep 13 16:42:19.877674 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1792/3595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:19 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1190 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:20.899901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:20.900513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:20.907157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.907643 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.908082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.908771 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.909224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.909649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.972392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.979979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4bacf763-ea97-459d-9aa4-557277a9afb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1190 microversion: 2.1 time: 0.083972 Sep 13 16:42:20.980569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1804/3596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:20 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1190 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:22.003893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:22.004524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:22.010860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.011377 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.011815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.012506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.012956 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.013385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.074715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:22.083152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fd51e10-5b53-4bac-843a-79ed3ec38a0b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1208 microversion: 2.1 time: 0.083930 Sep 13 16:42:22.083738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1793/3597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:23.107498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:23.108100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:23.114629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.115133 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.115562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.116235 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.116683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.117102 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.244956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:23.252902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-baa5d465-ccee-44c8-b1df-935a5e2e79e9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1276 microversion: 2.1 time: 0.149257 Sep 13 16:42:23.253458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1805/3598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:23 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:24.084564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f5f69d5f-9e38-4391-aec1-3779f3828fe4 req-4edb2a2d-4b4d-4e85-97f8-f3258d331441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91b7693-40ea-4802-af89-489aa88bd4ca", "tag": "8f950b6b-6ff6-4c03-9e25-d74cfa06c865"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:24.094731 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f5f69d5f-9e38-4391-aec1-3779f3828fe4 req-4edb2a2d-4b4d-4e85-97f8-f3258d331441 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.095281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f5f69d5f-9e38-4391-aec1-3779f3828fe4 req-4edb2a2d-4b4d-4e85-97f8-f3258d331441 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.095721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f5f69d5f-9e38-4391-aec1-3779f3828fe4 req-4edb2a2d-4b4d-4e85-97f8-f3258d331441 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.106302 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f5f69d5f-9e38-4391-aec1-3779f3828fe4 req-4edb2a2d-4b4d-4e85-97f8-f3258d331441 service nova] Creating event network-changed:8f950b6b-6ff6-4c03-9e25-d74cfa06c865 for instance b91b7693-40ea-4802-af89-489aa88bd4ca on hv-cinder-82002 Sep 13 16:42:24.111887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f5f69d5f-9e38-4391-aec1-3779f3828fe4 req-4edb2a2d-4b4d-4e85-97f8-f3258d331441 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031254 Sep 13 16:42:24.112672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1794/3599] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:24.276354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:24.277106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:24.284891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.285366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.285800 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.286479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.287027 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.287452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.422977 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:24.430692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84d7c8a2-bacc-4f84-b031-45f1a0800cfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1276 microversion: 2.1 time: 0.158347 Sep 13 16:42:24.431507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1806/3600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:24 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:25.454993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:25.455941 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:25.462612 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.463129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.463569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.464306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.464766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.465245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.584307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-837476027", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "networks": [{"uuid": "26b2c175-dccf-48ae-8ca0-a270455ecbca"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:25.608237 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:25.617931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79e3a759-39af-486c-ad9b-1f3d83b82853 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.167525 Sep 13 16:42:25.618497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1795/3601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:25 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:25.642527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] validate_networks() for [('26b2c175-dccf-48ae-8ca0-a270455ecbca', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:42:26.044713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:42:26.045136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:42:26.045611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:42:26.046019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:42:26.046438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:42:26.055745 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.056223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.056658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.057377 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.057857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.058281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.076234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Getting quotas for project b70b7595c0e44310ba172e35bc6e8fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:26.081351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Getting quotas for user 94f08e22c26f4c5d8a6789b1d7a0e1a7 and project b70b7595c0e44310ba172e35bc6e8fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:26.092284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:42:26.095296 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:42:26.140030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-688321ac-8570-4681-aea0-0c9756a8eb78 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559720 Sep 13 16:42:26.141385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1807/3602] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:42:26.153014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e38dd93-f69f-497c-a6a6-580410ed99a4 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.153461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e38dd93-f69f-497c-a6a6-580410ed99a4 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.157310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:26.159412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:26.216164 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e38dd93-f69f-497c-a6a6-580410ed99a4 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.224038 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e38dd93-f69f-497c-a6a6-580410ed99a4 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1213 microversion: 2.1 time: 0.075588 Sep 13 16:42:26.224916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1796/3603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:26.642794 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.643629 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.659397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.659959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.660420 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.661175 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.661663 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.662098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.834500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.850263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-611f5699-68ee-4bf9-b78f-156ae104a958 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.212315 Sep 13 16:42:26.869710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1808/3604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:27.247624 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:27.248363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:27.255416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.256036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.256710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.257403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.257914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.258336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.326887 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:27.336469 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-adebe048-5836-4aca-a1f0-b55db4343a84 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1273 microversion: 2.1 time: 0.093315 Sep 13 16:42:27.351196 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1797/3605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:27 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:27.879285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:27.881237 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:27.888870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.889469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.890018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.891871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.892504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.893040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.050830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.058764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b0c72b87-4da4-452b-bd2f-d06d964178cb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.184117 Sep 13 16:42:28.059453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1809/3606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:27 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:28.362472 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:28.363222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:28.369540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.370026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.370460 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.371177 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.371626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.372049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.505465 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.513184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-235fb1b5-a80c-4703-90e8-736022bd373b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.155619 Sep 13 16:42:28.513804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1798/3607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:28 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:28.629230 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-78ca27cc-80e4-4943-abe0-679a8b08da92 req-a4d4c951-7ffc-4f01-9a00-1b08544bc731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "941eb7d1-5311-48d1-a44e-a834fa017668", "tag": "725a0ed1-caf4-41f6-8fe6-3f4f12a5fea4"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:28.638384 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-78ca27cc-80e4-4943-abe0-679a8b08da92 req-a4d4c951-7ffc-4f01-9a00-1b08544bc731 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.638848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-78ca27cc-80e4-4943-abe0-679a8b08da92 req-a4d4c951-7ffc-4f01-9a00-1b08544bc731 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.639303 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-78ca27cc-80e4-4943-abe0-679a8b08da92 req-a4d4c951-7ffc-4f01-9a00-1b08544bc731 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.650043 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-78ca27cc-80e4-4943-abe0-679a8b08da92 req-a4d4c951-7ffc-4f01-9a00-1b08544bc731 service nova] Creating event network-changed:725a0ed1-caf4-41f6-8fe6-3f4f12a5fea4 for instance 941eb7d1-5311-48d1-a44e-a834fa017668 on hv-cinder-82002 Sep 13 16:42:28.656672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-78ca27cc-80e4-4943-abe0-679a8b08da92 req-a4d4c951-7ffc-4f01-9a00-1b08544bc731 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031320 Sep 13 16:42:28.657671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1810/3608] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:42:29.083468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:29.084081 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:29.090005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.090490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.090951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.091638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.092090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.092518 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.220262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:29.228004 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-462ee59e-0881-4404-ae3c-78bb38d857d1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.148878 Sep 13 16:42:29.228561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1799/3609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:29 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:29.536742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:29.537344 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:29.543916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.544386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.544817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.545491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.545934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.546350 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.676983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:29.684515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-03fc7b79-6131-4cd5-bfed-6affb479b456 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.152049 Sep 13 16:42:29.685069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1811/3610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:29 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:30.250345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:30.250991 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:30.257569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.258056 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.258525 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.259250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.259710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.260142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.388873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:30.396587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-251422b4-91fb-45cc-97a1-7c2f403ac210 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.150103 Sep 13 16:42:30.397148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1800/3611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:30 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:30.708719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:30.709250 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:30.715845 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.716341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.716775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.717461 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.717914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.718338 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.850479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:30.857996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3221d1dc-3f9b-4073-805c-b7d89cd1a4fc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.153503 Sep 13 16:42:30.858560 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1812/3612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:30 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:31.419245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:31.419893 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:31.426230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.426710 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.427181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.427870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.428321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.428745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.559929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.567988 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12a8ba47-f2bf-4833-82af-9e22734c2d72 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.152679 Sep 13 16:42:31.568549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1801/3613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:31 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:31.881326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:31.882878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:31.889317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.889799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.890241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.891637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.892223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.892649 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.026275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:32.034990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6570b480-267f-47a3-b226-f1e5d1cd136c tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.157460 Sep 13 16:42:32.035967 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1813/3614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:31 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:32.590989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:32.591611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:32.598156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:32.598645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:32.599124 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.599818 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:32.600274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:32.600707 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.732931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:32.741484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e3830ce-6838-4efd-bd84-b105d7e650d7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.154323 Sep 13 16:42:32.742110 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1802/3615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:32 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:33.058263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:33.058817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:33.066080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.066080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.066470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.067193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.067648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.068073 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.194501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.202056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2e366fd9-0de4-432a-933c-c37df478912b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.147727 Sep 13 16:42:33.202627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1814/3616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:33 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:33.764273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:33.765092 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:33.771778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.772264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.772703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.773389 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.774301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.774301 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.923726 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.932463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d795a10-e80a-4614-b011-32ae7be159f1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.172094 Sep 13 16:42:33.933231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1803/3617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:33 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:34.226095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.226784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.233621 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.234118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.235151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.236099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.236562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.237003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.368672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:34.377084 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e53a378-70ab-4878-af90-7b167a2d1669 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.154919 Sep 13 16:42:34.377653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1815/3618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:34.961026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.961771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.967847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.968335 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.968775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.969477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.970039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.970498 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.112926 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:35.120652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c964a717-2cad-4d2f-83a6-a6a010069ea4 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.163515 Sep 13 16:42:35.121513 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1804/3619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:35.399840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:35.401036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:35.408363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:35.408850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:35.409292 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.409990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:35.410445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:35.410871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.544458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:35.554434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6d53928-50ff-4a00-8454-6819d6edf6dc tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.158498 Sep 13 16:42:35.555220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1816/3620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:35 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:36.131325 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-88a66670-be88-4ff7-acee-42e121886fe3 req-cb4f9a58-6cba-4aab-a2d3-68563164a1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "941eb7d1-5311-48d1-a44e-a834fa017668", "name": "network-vif-plugged", "status": "completed", "tag": "725a0ed1-caf4-41f6-8fe6-3f4f12a5fea4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:36.143884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-88a66670-be88-4ff7-acee-42e121886fe3 req-cb4f9a58-6cba-4aab-a2d3-68563164a1aa service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.144360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-88a66670-be88-4ff7-acee-42e121886fe3 req-cb4f9a58-6cba-4aab-a2d3-68563164a1aa service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.144789 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-88a66670-be88-4ff7-acee-42e121886fe3 req-cb4f9a58-6cba-4aab-a2d3-68563164a1aa service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.149886 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:36.150775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:36.158036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:36.159130 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:36.161687 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.162604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.163397 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.164124 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.164580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.165008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.166215 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-88a66670-be88-4ff7-acee-42e121886fe3 req-cb4f9a58-6cba-4aab-a2d3-68563164a1aa service nova] Creating event network-vif-plugged:725a0ed1-caf4-41f6-8fe6-3f4f12a5fea4 for instance 941eb7d1-5311-48d1-a44e-a834fa017668 on hv-cinder-82002 Sep 13 16:42:36.176601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-88a66670-be88-4ff7-acee-42e121886fe3 req-cb4f9a58-6cba-4aab-a2d3-68563164a1aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211930 Sep 13 16:42:36.177794 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1805/3621] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:36.337360 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:36.347153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf5d7225-16f6-4cf9-b5ab-77fb60e60f73 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.204108 Sep 13 16:42:36.348000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1817/3622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:36 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:36.577954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:36.579236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:36.581482 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:36.587286 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.587775 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.588274 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.588966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.589419 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.589872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.723743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:36.732234 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f967da8-053c-4111-b3f2-83ff35a54ce7 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.158366 Sep 13 16:42:36.732799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1806/3623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:36 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:37.369519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:37.370234 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:37.376683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:37.377170 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:37.377610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:37.378304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:37.378756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:37.379219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:37.516049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:37.524660 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59d826b0-a701-4db4-885b-b05f1676e8b6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.158892 Sep 13 16:42:37.525266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1818/3624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:37 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:37.755176 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:37.755785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:37.762084 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:37.763187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:37.763629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:37.764315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:37.764763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:37.765182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:37.904405 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:37.913017 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83cccc70-71ea-402b-aae6-b960c2c37d10 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1313 microversion: 2.1 time: 0.161748 Sep 13 16:42:37.914570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1807/3625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:37 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:38.191019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f2c27c05-7288-411b-90fa-b00d6eea9dff req-435603a3-f497-4444-9eca-4bbe75ba7071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91b7693-40ea-4802-af89-489aa88bd4ca", "name": "network-vif-plugged", "status": "completed", "tag": "8f950b6b-6ff6-4c03-9e25-d74cfa06c865"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:38.200331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f2c27c05-7288-411b-90fa-b00d6eea9dff req-435603a3-f497-4444-9eca-4bbe75ba7071 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.200798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f2c27c05-7288-411b-90fa-b00d6eea9dff req-435603a3-f497-4444-9eca-4bbe75ba7071 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.201226 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f2c27c05-7288-411b-90fa-b00d6eea9dff req-435603a3-f497-4444-9eca-4bbe75ba7071 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.212913 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f2c27c05-7288-411b-90fa-b00d6eea9dff req-435603a3-f497-4444-9eca-4bbe75ba7071 service nova] Creating event network-vif-plugged:8f950b6b-6ff6-4c03-9e25-d74cfa06c865 for instance b91b7693-40ea-4802-af89-489aa88bd4ca on hv-cinder-82002 Sep 13 16:42:38.218006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f2c27c05-7288-411b-90fa-b00d6eea9dff req-435603a3-f497-4444-9eca-4bbe75ba7071 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030768 Sep 13 16:42:38.218616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1819/3626] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:38.546908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:38.547704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:38.553595 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.554074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.554511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.555223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.555675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.556096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.690245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:38.699118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78f2700d-10c9-444c-8a2e-50d2ccc45ca2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1264 microversion: 2.1 time: 0.155924 Sep 13 16:42:38.699701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1808/3627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:38 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:38.938026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:38.939331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:38.946082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.946604 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.947114 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.947793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.948233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.948689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.091657 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:39.100025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-98338f40-1806-468a-b20b-5040126d51ee tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1496 microversion: 2.1 time: 0.166265 Sep 13 16:42:39.100589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1820/3628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:38 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:39.539169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.539733 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.545842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.546311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.546768 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.547468 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.548646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.549187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.569807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:39.579682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:39.670740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0efca739-17b0-4cbc-90e9-96382033d172 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "DELETE /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 204 len: 0 microversion: 2.1 time: 0.135215 Sep 13 16:42:39.671466 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1809/3629] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:42:39 2022] DELETE /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:42:39.680228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.680844 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.687121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.687605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.688307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.689104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.689563 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.689995 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.709106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:39.723957 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.724762 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.730625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.731150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.731590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.732283 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.732730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.733163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.889690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:39.898254 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7e47490-ff9e-414b-9ff5-feff7a23f9c6 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1502 microversion: 2.1 time: 0.221918 Sep 13 16:42:39.898954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1821/3630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:39 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:39.916770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:39.924695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1b46aef6-9cb1-400d-bcf4-3bc3f684f41c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1451 microversion: 2.1 time: 0.205755 Sep 13 16:42:39.925256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1810/3631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:39 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1451 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:39.947916 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.948618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.955519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.956000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.956443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.957129 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.957584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.958012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.097839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:40.106068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2ef9185-37c0-45cd-bc66-93a1daf49a15 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1451 microversion: 2.1 time: 0.162228 Sep 13 16:42:40.106632 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1822/3632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:39 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:40.921652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:40.922168 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:40.929439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.929905 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.930384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.931199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.931650 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.932109 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:41.158854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:41.166514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8227577-598b-4fbe-be3d-731b5af6fdb8 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1502 microversion: 2.1 time: 0.248806 Sep 13 16:42:41.167118 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1811/3633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:40 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:42.012321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-5b1c45d8-adfd-4320-9264-2d0765d32f54 req-6eeeb4bf-2f17-4e08-bd17-4b7d8d510897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91b7693-40ea-4802-af89-489aa88bd4ca", "tag": "8f950b6b-6ff6-4c03-9e25-d74cfa06c865"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:42.023525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5b1c45d8-adfd-4320-9264-2d0765d32f54 req-6eeeb4bf-2f17-4e08-bd17-4b7d8d510897 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.024281 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5b1c45d8-adfd-4320-9264-2d0765d32f54 req-6eeeb4bf-2f17-4e08-bd17-4b7d8d510897 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.024909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5b1c45d8-adfd-4320-9264-2d0765d32f54 req-6eeeb4bf-2f17-4e08-bd17-4b7d8d510897 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.038006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-5b1c45d8-adfd-4320-9264-2d0765d32f54 req-6eeeb4bf-2f17-4e08-bd17-4b7d8d510897 service nova] Creating event network-changed:8f950b6b-6ff6-4c03-9e25-d74cfa06c865 for instance b91b7693-40ea-4802-af89-489aa88bd4ca on hv-cinder-82002 Sep 13 16:42:42.051569 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-5b1c45d8-adfd-4320-9264-2d0765d32f54 req-6eeeb4bf-2f17-4e08-bd17-4b7d8d510897 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042859 Sep 13 16:42:42.052255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1823/3634] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:42.192160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:42.193317 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:42.207852 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.215775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.216636 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.218623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.219695 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.223952 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.268283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.268985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.270061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.270833 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lazy-loading 'fault' on Instance uuid 941eb7d1-5311-48d1-a44e-a834fa017668 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:42.322706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-163bdb06-fbee-4224-84b6-7e0dd48eef06 req-a96d2ea5-f180-4568-be74-b76574a32ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "941eb7d1-5311-48d1-a44e-a834fa017668", "name": "network-vif-deleted", "tag": "725a0ed1-caf4-41f6-8fe6-3f4f12a5fea4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:42.339411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-163bdb06-fbee-4224-84b6-7e0dd48eef06 req-a96d2ea5-f180-4568-be74-b76574a32ed8 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.341840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-163bdb06-fbee-4224-84b6-7e0dd48eef06 req-a96d2ea5-f180-4568-be74-b76574a32ed8 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.342686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-163bdb06-fbee-4224-84b6-7e0dd48eef06 req-a96d2ea5-f180-4568-be74-b76574a32ed8 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.352356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:42.367618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84bab19f-dccf-44ea-8247-0cfb2a36333b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 200 len: 1303 microversion: 2.1 time: 0.181159 Sep 13 16:42:42.369836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-163bdb06-fbee-4224-84b6-7e0dd48eef06 req-a96d2ea5-f180-4568-be74-b76574a32ed8 service nova] Creating event network-vif-deleted:725a0ed1-caf4-41f6-8fe6-3f4f12a5fea4 for instance 941eb7d1-5311-48d1-a44e-a834fa017668 on hv-cinder-82002 Sep 13 16:42:42.370457 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1824/3635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:42 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 1303 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:42.378161 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-163bdb06-fbee-4224-84b6-7e0dd48eef06 req-a96d2ea5-f180-4568-be74-b76574a32ed8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329087 Sep 13 16:42:42.379064 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1812/3636] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:43.394627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:43.395271 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 941eb7d1-5311-48d1-a44e-a834fa017668] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:43.402243 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:43.402881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:43.403416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.404284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:43.404823 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:43.405290 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.419798 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] HTTP exception thrown: Instance 941eb7d1-5311-48d1-a44e-a834fa017668 could not be found. Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Request method failure captured: Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 HTTP/1.1 Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILLqcSf6v25V-1JNyUdxjXf1v9hqGsgwSoPvCK-ZuvYar_BZFPBetlEMY6RrpLZhDGYiO7lspdQq_r54Nb1_q9vzIDHMRhwpJeuFLwYZalMS43n3cPILUOwzztEDNVdoUN5GaPmrtAj33CWoZBeQLg4-szHsC-mKP6UIUtCi2H3xwos Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: b70b7595c0e44310ba172e35bc6e8fe3 Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesActionsTest-1853491952 Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:42:43.421455 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b70b7595c0e44310ba172e35bc6e8fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b70b7595c0e44310ba172e35bc6e8fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b70b7595c0e44310ba172e35bc6e8fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b70b7595c0e44310ba172e35bc6e8fe3"}]}] Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesActionsTest-1853491952 Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: b70b7595c0e44310ba172e35bc6e8fe3 Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesActionsTest-1853491952 Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesActionsTest-1853491952-project Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 94f08e22c26f4c5d8a6789b1d7a0e1a7 Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesActionsTest-1853491952-project Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 941eb7d1-5311-48d1-a44e-a834fa017668 could not be found. Sep 13 16:42:43.424132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '941eb7d1-5311-48d1-a44e-a834fa017668'} Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 941eb7d1-5311-48d1-a44e-a834fa017668 could not be found. Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:43.425464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 941eb7d1-5311-48d1-a44e-a834fa017668 could not be found. Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 941eb7d1-5311-48d1-a44e-a834fa017668 could not be found. Sep 13 16:42:43.427019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:42:43.427983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Returning 404 to user: Instance 941eb7d1-5311-48d1-a44e-a834fa017668 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:43.427983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9ae85e7-27b3-4815-ab52-f586a1bcd13d tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668" status: 404 len: 111 microversion: 2.1 time: 0.033750 Sep 13 16:42:43.427983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1825/3637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:43 2022] GET /compute/v2.1/servers/941eb7d1-5311-48d1-a44e-a834fa017668 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:42:43.526264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1058640090", "imageRef": "b8a929ff-33b4-4fb5-89c1-910eeafe71d3", "flavorRef": "452", "networks": [{"uuid": "26b2c175-dccf-48ae-8ca0-a270455ecbca"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:43.579654 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] validate_networks() for [('26b2c175-dccf-48ae-8ca0-a270455ecbca', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:42:43.993767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:42:43.994197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:42:43.994702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:42:43.995149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:42:43.995565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:42:44.007918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:44.008519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:44.008954 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:44.009670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:44.010116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:44.010539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:44.033632 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Getting quotas for project b70b7595c0e44310ba172e35bc6e8fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:44.037550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Getting quotas for user 94f08e22c26f4c5d8a6789b1d7a0e1a7 and project b70b7595c0e44310ba172e35bc6e8fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:44.050174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:42:44.052648 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a929ff-33b4-4fb5-89c1-910eeafe71d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:42:44.102313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0b9002c-6140-49ea-9747-5d472c57cf39 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580698 Sep 13 16:42:44.103485 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1813/3638] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:42:44.114561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4bcdfdde-5488-4dbe-9102-723fd394d81e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:44.115356 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4bcdfdde-5488-4dbe-9102-723fd394d81e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:44.170201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4bcdfdde-5488-4dbe-9102-723fd394d81e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:44.177180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4bcdfdde-5488-4dbe-9102-723fd394d81e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1214 microversion: 2.1 time: 0.066737 Sep 13 16:42:44.178056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1826/3639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:44 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:45.203758 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:45.204393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:45.211875 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:45.212835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:45.213496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:45.214233 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:45.215022 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:45.215698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:45.285636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:45.294763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ca41cb8-307e-429d-bf7a-98826b0ba9a1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1284 microversion: 2.1 time: 0.098372 Sep 13 16:42:45.295423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1814/3640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:45 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:46.321182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:46.321590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:46.324255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:46.331547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:46.332033 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:46.332625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:46.333517 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:46.334121 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:46.334699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:46.579778 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4a7557a0-2fb2-48db-b07c-f0d072f613ab req-8473db36-7a94-44f4-9234-9bc69323ebee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25da4f2e-1a81-4f37-bbd0-b12c76cf15a0", "tag": "811046da-222f-4d6f-a06b-ed2b80cf35d6"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:46.595574 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:46.599135 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4a7557a0-2fb2-48db-b07c-f0d072f613ab req-8473db36-7a94-44f4-9234-9bc69323ebee service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:46.600074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4a7557a0-2fb2-48db-b07c-f0d072f613ab req-8473db36-7a94-44f4-9234-9bc69323ebee service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:46.600681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4a7557a0-2fb2-48db-b07c-f0d072f613ab req-8473db36-7a94-44f4-9234-9bc69323ebee service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:46.621446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4a7557a0-2fb2-48db-b07c-f0d072f613ab req-8473db36-7a94-44f4-9234-9bc69323ebee service nova] Creating event network-changed:811046da-222f-4d6f-a06b-ed2b80cf35d6 for instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 on hv-cinder-82002 Sep 13 16:42:46.627634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4a7557a0-2fb2-48db-b07c-f0d072f613ab req-8473db36-7a94-44f4-9234-9bc69323ebee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059062 Sep 13 16:42:46.628844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1815/3641] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:46.823587 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:46.831492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8da1d3e3-fbf2-4d7a-95fc-87e9c2d1669e tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.515799 Sep 13 16:42:46.832056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1827/3642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:46 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:47.856587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:47.857288 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:47.864134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.864621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.865057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:47.865751 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.866202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.867372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:48.049414 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:48.057235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0038730-d25e-45b1-a502-3bbc52c8214b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.205044 Sep 13 16:42:48.057763 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1816/3643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:47 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:49.081379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:49.082085 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:49.088787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.089264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.089694 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.090374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.090816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.091264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.220019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:49.227538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbd3d980-5b67-4934-a641-673e276c2835 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.150964 Sep 13 16:42:49.228107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1828/3644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:49 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:50.250385 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:50.251030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:50.257496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.257978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.258410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.259122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.259565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.259985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.389868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:50.399061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4391631e-74b6-4998-a3ba-1b489c7075da tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.152426 Sep 13 16:42:50.399770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1817/3645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:50 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:51.422479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:51.423127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:51.430353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.430862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.431316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.432028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.432502 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.432922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.568792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:51.576374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df7f3f91-01b5-4e2e-a87a-c414e741aadd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.157838 Sep 13 16:42:51.576936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1829/3646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:51 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:52.050997 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1d8bc9c5-5acf-4685-9ebc-38a93e5e75df req-17e59cb1-3c53-4608-8e4b-706fedba1821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25da4f2e-1a81-4f37-bbd0-b12c76cf15a0", "name": "network-vif-plugged", "status": "completed", "tag": "811046da-222f-4d6f-a06b-ed2b80cf35d6"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:52.071316 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1d8bc9c5-5acf-4685-9ebc-38a93e5e75df req-17e59cb1-3c53-4608-8e4b-706fedba1821 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.071814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1d8bc9c5-5acf-4685-9ebc-38a93e5e75df req-17e59cb1-3c53-4608-8e4b-706fedba1821 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.072250 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1d8bc9c5-5acf-4685-9ebc-38a93e5e75df req-17e59cb1-3c53-4608-8e4b-706fedba1821 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:52.085090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1d8bc9c5-5acf-4685-9ebc-38a93e5e75df req-17e59cb1-3c53-4608-8e4b-706fedba1821 service nova] Creating event network-vif-plugged:811046da-222f-4d6f-a06b-ed2b80cf35d6 for instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 on hv-cinder-82002 Sep 13 16:42:52.090457 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1d8bc9c5-5acf-4685-9ebc-38a93e5e75df req-17e59cb1-3c53-4608-8e4b-706fedba1821 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054735 Sep 13 16:42:52.091235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1818/3647] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:52.600574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:52.601184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:52.607552 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.608025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.608458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:52.609134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.609578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.609996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:52.740326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:52.748008 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f53b21fa-7172-4cb7-a94d-16f9e1c8c500 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.152123 Sep 13 16:42:52.748571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1830/3648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:52 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:53.771929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:53.772626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:53.778729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:53.779243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:53.779678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:53.780359 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:53.780807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:53.781229 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:53.910505 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:53.918155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48db8da6-e4f0-493d-bdd5-96ed33afb6bb tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.151507 Sep 13 16:42:53.918712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1819/3649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:53 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:54.941188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:54.941793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:54.944513 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:54.951326 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:54.951799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:54.952263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:54.952989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:54.953437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:54.953857 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:55.083856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:55.091375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e13f12d6-a9ba-49ae-b266-eba6c564bad3 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.154092 Sep 13 16:42:55.091936 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1831/3650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:54 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:56.114802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:56.115439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:56.117381 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:56.118033 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:56.124757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:56.125236 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:56.125669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:56.126349 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:56.127621 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:56.128078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:56.256827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:56.264492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2fe8cb3f-71c4-4f25-b128-92a6df118191 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1314 microversion: 2.1 time: 0.154187 Sep 13 16:42:56.265041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1820/3651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:56 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:57.286942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:57.287562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:57.293906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.294398 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.294843 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.295555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.296014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.296443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.429312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:57.437047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5bc596fb-d8a6-478d-998a-2367c4d2e9f5 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1498 microversion: 2.1 time: 0.154096 Sep 13 16:42:57.437617 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1832/3652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:57 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:58.033453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:58.034031 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:58.040428 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.040911 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.041348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.042036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.042486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.042924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.068358 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:58.140528 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4991cb5-b9c9-4060-b3e2-51d0c49e6a6b tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "DELETE /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 204 len: 0 microversion: 2.1 time: 0.111166 Sep 13 16:42:58.141047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1821/3653] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:42:58 2022] DELETE /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:42:58.149528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:58.150154 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:58.156030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.156510 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.156946 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.157627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.158637 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.159141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.286231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:58.294201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db95f75e-2b93-4ceb-aef1-c9ed92dd2dea tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1504 microversion: 2.1 time: 0.148486 Sep 13 16:42:58.294792 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1833/3654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:58 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:59.318638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:59.319266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:59.325767 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.326244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.326680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.327392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.327844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.328269 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.455933 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:59.463453 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8ada6a0-9aa1-44b3-9e50-548c62a6fae1 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1504 microversion: 2.1 time: 0.149868 Sep 13 16:42:59.464021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1822/3655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:59 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:00.487574 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:00.488179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:00.494516 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:00.495020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:00.495451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:00.496123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:00.496566 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:00.496983 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:00.626443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:00.634756 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0bc387c4-3f85-4fa6-9deb-5e80ce223820 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1504 microversion: 2.1 time: 0.151647 Sep 13 16:43:00.635364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1834/3656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:00 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:01.657702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:01.658441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:01.664816 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:01.665293 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:01.665735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:01.666448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:01.666914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:01.667348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:01.793190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:01.801069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e9b4848-4d13-4d27-988f-f06564f092dd tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1504 microversion: 2.1 time: 0.147132 Sep 13 16:43:01.801636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1823/3657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:01 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:02.698961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f0072e9b-3dd6-4242-9298-ffd307938003 req-54702964-1b5d-4666-ab2b-a469a70f65d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25da4f2e-1a81-4f37-bbd0-b12c76cf15a0", "name": "network-vif-deleted", "tag": "811046da-222f-4d6f-a06b-ed2b80cf35d6"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:02.709462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f0072e9b-3dd6-4242-9298-ffd307938003 req-54702964-1b5d-4666-ab2b-a469a70f65d6 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.709945 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f0072e9b-3dd6-4242-9298-ffd307938003 req-54702964-1b5d-4666-ab2b-a469a70f65d6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.710385 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f0072e9b-3dd6-4242-9298-ffd307938003 req-54702964-1b5d-4666-ab2b-a469a70f65d6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.722651 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f0072e9b-3dd6-4242-9298-ffd307938003 req-54702964-1b5d-4666-ab2b-a469a70f65d6 service nova] Creating event network-vif-deleted:811046da-222f-4d6f-a06b-ed2b80cf35d6 for instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 on hv-cinder-82002 Sep 13 16:43:02.727982 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f0072e9b-3dd6-4242-9298-ffd307938003 req-54702964-1b5d-4666-ab2b-a469a70f65d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032687 Sep 13 16:43:02.728581 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1835/3658] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:02.824966 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:02.825666 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:02.833145 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.833728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.834226 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.835046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.835502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.835924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.871548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.872030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.872463 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.872903 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lazy-loading 'fault' on Instance uuid 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:02.917415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f08e22c26f4c5d8a6789b1d7a0e1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70b7595c0e44310ba172e35bc6e8fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:02.924892 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b7b89c7-abae-4d3f-8120-389902091103 tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 200 len: 1304 microversion: 2.1 time: 0.104129 Sep 13 16:43:02.925442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1824/3659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:02 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:03.948298 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:03.949036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] [instance: 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:03.956379 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.956866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.957305 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.957997 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.958452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.958878 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.974024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] HTTP exception thrown: Instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 could not be found. Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Request method failure captured: Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 HTTP/1.1 Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILLqcSf6v25V-1JNyUdxjXf1v9hqGsgwSoPvCK-ZuvYar_BZFPBetlEMY6RrpLZhDGYiO7lspdQq_r54Nb1_q9vzIDHMRhwpJeuFLwYZalMS43n3cPILUOwzztEDNVdoUN5GaPmrtAj33CWoZBeQLg4-szHsC-mKP6UIUtCi2H3xwos Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: b70b7595c0e44310ba172e35bc6e8fe3 Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesActionsTest-1853491952 Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:43:03.975677 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b70b7595c0e44310ba172e35bc6e8fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b70b7595c0e44310ba172e35bc6e8fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b70b7595c0e44310ba172e35bc6e8fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b70b7595c0e44310ba172e35bc6e8fe3"}]}] Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesActionsTest-1853491952 Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: b70b7595c0e44310ba172e35bc6e8fe3 Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesActionsTest-1853491952 Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesActionsTest-1853491952-project Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 94f08e22c26f4c5d8a6789b1d7a0e1a7 Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesActionsTest-1853491952-project Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 could not be found. Sep 13 16:43:03.977184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '25da4f2e-1a81-4f37-bbd0-b12c76cf15a0'} Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 could not be found. Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:03.978097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 could not be found. Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 could not be found. Sep 13 16:43:03.979515 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:43:03.980699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] Returning 404 to user: Instance 25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:03.980699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b213e38-77a2-452b-bf33-a31741908aed tempest-VolumesActionsTest-1853491952 tempest-VolumesActionsTest-1853491952-project] 10.222.0.50 "GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0" status: 404 len: 111 microversion: 2.1 time: 0.033409 Sep 13 16:43:03.980699 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1836/3660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:03 2022] GET /compute/v2.1/servers/25da4f2e-1a81-4f37-bbd0-b12c76cf15a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:07.977685 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:07.978424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:07.979307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:44:07.979451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.50) !!! Sep 13 16:44:07.984225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bdf66fcc-5b7c-4684-86f6-805f9bfa1ad6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Action: 'create', calling method: .version_select at 0x7fb67fa49820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-4394820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbbr4kYO/bi1Fk8lKWF4Cfn3qMV4X54eLzbiWvbhcdvXiZZIAKUabytLZFx964SYiUOWW9uqzQfZAivIGxLwKjD80mMREWjkWuh65j5XKzgPU1Rkb1TosAu8fJC0Dirtg=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:08.004481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-bdf66fcc-5b7c-4684-86f6-805f9bfa1ad6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Getting quotas for project 08f6037f42c34be7b2407c258d8885be. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:08.008206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-bdf66fcc-5b7c-4684-86f6-805f9bfa1ad6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Getting quotas for user 91ce9cad1eab41efb4da9503c23ad073 and project 08f6037f42c34be7b2407c258d8885be. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:08.033962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bdf66fcc-5b7c-4684-86f6-805f9bfa1ad6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.058273 Sep 13 16:44:08.034557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1825/3661] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:44:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:08.086120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2141184298", "imageRef": "8e7b0cd7-1da6-447a-bdf9-8ca5f7df4686", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-4394820", "networks": [{"uuid": "28fcfe5d-701e-45cf-b769-f9c0cf92f70a"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:08.096832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=19 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:08.097473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=72 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:08.142120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] validate_networks() for [('28fcfe5d-701e-45cf-b769-f9c0cf92f70a', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:44:08.508786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:44:08.509205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:44:08.509702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:44:08.510131 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:44:08.510537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:44:08.520054 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:08.520530 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:08.520959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.521671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:08.522115 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:08.522538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.538990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Getting quotas for project 08f6037f42c34be7b2407c258d8885be. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:08.542835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Getting quotas for user 91ce9cad1eab41efb4da9503c23ad073 and project 08f6037f42c34be7b2407c258d8885be. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:08.554063 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:44:08.556270 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e7b0cd7-1da6-447a-bdf9-8ca5f7df4686',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:44:08.604018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b3e84ce-034f-4989-a527-d9c43ad99534 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522208 Sep 13 16:44:08.604653 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1837/3662] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:44:08.615873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db9882e9-2de0-49bf-acb2-aae310d5bc2a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:08.616849 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db9882e9-2de0-49bf-acb2-aae310d5bc2a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:08.672307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db9882e9-2de0-49bf-acb2-aae310d5bc2a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:08.680917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db9882e9-2de0-49bf-acb2-aae310d5bc2a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1256 microversion: 2.1 time: 0.069103 Sep 13 16:44:08.681491 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1826/3663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:08 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:09.705228 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:09.706182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:09.712869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.713353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.713853 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.714884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.715010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.715426 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.779719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:09.787902 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee6136dc-8777-4e7c-95d1-ef2d7f74428c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1314 microversion: 2.1 time: 0.087841 Sep 13 16:44:09.788466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1838/3664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:09 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1314 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:10.811517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:10.812984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:10.820652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.821136 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.821573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.822439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.823047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.823692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.976655 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:10.993242 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48e0f671-b843-4f0e-9223-ef17d55aef89 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.185507 Sep 13 16:44:10.994545 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1827/3665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:10 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:12.019850 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:12.020367 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:12.027181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.027892 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.028324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.029019 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.029465 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.030140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.242321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:12.253864 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e3645d95-edf4-4b46-82d7-7dcbc85be0f6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.239614 Sep 13 16:44:12.254710 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1839/3666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:12 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:13.276895 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:13.277512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:13.284506 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:13.285660 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:13.286514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:13.286978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:13.287519 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:13.287961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:13.443417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:13.451228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc65e2e1-1549-451b-84bd-5c9734302b24 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.178065 Sep 13 16:44:13.451796 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1828/3667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:13 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:14.476888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:14.477527 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:14.484125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.484633 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.485087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.485786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.486335 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.486764 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.705057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:14.713781 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-706707d3-a3f3-441b-85b0-c8fe00e65b4f tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.240685 Sep 13 16:44:14.714576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1840/3668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:14 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:15.740630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:15.741239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:15.747785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:15.748273 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:15.748712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:15.749486 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:15.750044 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:15.750565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:15.894217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:15.903781 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7165781-01f3-418e-a30d-8721490b5187 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.166880 Sep 13 16:44:15.906043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1829/3669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:15 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:16.928010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:16.929307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:16.937306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:16.938429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:16.939473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:16.940451 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:16.941127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:16.941901 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:17.092248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:17.101422 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2e586d8f-0061-4c77-88f3-685cdfed65ec tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.177762 Sep 13 16:44:17.102328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1841/3670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:16 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:18.124327 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:18.124958 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:18.131689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.132167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.132603 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.133290 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.133734 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.134154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.263658 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:18.271845 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0fbb574e-ea74-48e9-bbb0-fe7fd4851cdf tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.151357 Sep 13 16:44:18.272508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1830/3671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:18 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:18.649647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-1c20277b-9c5b-4b30-81e4-b9c0ab9ca66f req-4066405e-255b-405b-8bd9-d9e5c9400c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:18.656452 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:18.657227 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:18.665414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1c20277b-9c5b-4b30-81e4-b9c0ab9ca66f req-4066405e-255b-405b-8bd9-d9e5c9400c53 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.665909 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1c20277b-9c5b-4b30-81e4-b9c0ab9ca66f req-4066405e-255b-405b-8bd9-d9e5c9400c53 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.666343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1c20277b-9c5b-4b30-81e4-b9c0ab9ca66f req-4066405e-255b-405b-8bd9-d9e5c9400c53 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.679470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-1c20277b-9c5b-4b30-81e4-b9c0ab9ca66f req-4066405e-255b-405b-8bd9-d9e5c9400c53 service nova] Creating event network-changed:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:44:18.684468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-1c20277b-9c5b-4b30-81e4-b9c0ab9ca66f req-4066405e-255b-405b-8bd9-d9e5c9400c53 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038803 Sep 13 16:44:18.685065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1842/3672] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:19.296016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:19.296665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:19.298691 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:19.304619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.305096 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.305535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.306223 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.306675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.307137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.438883 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:19.446478 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f6de6ff-9d5c-4e36-9ca2-5de1870a4c7b tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.154576 Sep 13 16:44:19.447066 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1831/3673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:19 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:20.470570 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:20.471211 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:20.477704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:20.478174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:20.478601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.479309 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:20.479754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:20.480173 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.613708 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:20.621274 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e83dfd5-8340-4575-8fb2-3d324c48132a tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.155425 Sep 13 16:44:20.621836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1843/3674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:20 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:21.643432 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:21.644046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:21.650422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:21.651052 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:21.651494 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:21.652187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:21.652643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:21.653074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:21.781490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:21.790522 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61705abc-38fa-441a-9e31-f481499d989e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.150917 Sep 13 16:44:21.791021 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1832/3675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:21 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:22.814357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:22.814987 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:22.821333 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.821813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.822246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.822947 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.823393 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.823811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.957148 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:22.964765 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bac8a382-68f7-4e3f-9996-8fd3abd1a710 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.154735 Sep 13 16:44:22.965320 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1844/3676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:22 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:23.987644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:23.988258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:23.994704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.995211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.995646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.996330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.996788 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.997213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.124539 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:24.133207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6dbf403-b982-4261-9f28-48750abd26f5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.149604 Sep 13 16:44:24.133766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1833/3677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:23 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:24.521334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c74023c6-9964-410f-ae5d-7714107ca795 req-821d4dcf-0c71-4c5b-a1ba-23eab1e3346c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "name": "network-vif-plugged", "status": "completed", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:24.531616 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c74023c6-9964-410f-ae5d-7714107ca795 req-821d4dcf-0c71-4c5b-a1ba-23eab1e3346c service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.532472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c74023c6-9964-410f-ae5d-7714107ca795 req-821d4dcf-0c71-4c5b-a1ba-23eab1e3346c service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.532795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c74023c6-9964-410f-ae5d-7714107ca795 req-821d4dcf-0c71-4c5b-a1ba-23eab1e3346c service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.544082 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c74023c6-9964-410f-ae5d-7714107ca795 req-821d4dcf-0c71-4c5b-a1ba-23eab1e3346c service nova] Creating event network-vif-plugged:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:44:24.550192 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c74023c6-9964-410f-ae5d-7714107ca795 req-821d4dcf-0c71-4c5b-a1ba-23eab1e3346c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032455 Sep 13 16:44:24.551077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1845/3678] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:25.155989 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:25.157220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:25.163870 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:25.164345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:25.164784 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:25.165462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:25.165909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:25.166326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:25.294618 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:25.302416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a46774ce-5beb-4310-818d-65c4b12070e7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1356 microversion: 2.1 time: 0.150305 Sep 13 16:44:25.303005 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1834/3679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:25 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:26.325535 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:26.326263 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:26.332876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.333352 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.333787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.334500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.334970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.335400 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.462313 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:26.470773 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c63e285-5e41-4a75-ac73-25ae396d899e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1547 microversion: 2.1 time: 0.149847 Sep 13 16:44:26.471382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1846/3680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:26 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:26.493438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:26.494049 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:26.500534 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.501091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.501531 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.502221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.502675 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.503138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.631898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:26.639456 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80cd6a8b-bfb5-4afe-805d-49de89e185dc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1547 microversion: 2.1 time: 0.149805 Sep 13 16:44:26.640018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1835/3681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:26 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:26.661884 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:26.666656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:26.667522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Searching by: {'deleted': False, 'project_id': '08f6037f42c34be7b2407c258d8885be'} {{(pid=120638) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:44:26.674013 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.674495 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.674958 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.675679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.676132 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.676558 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.765120 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.multi_cell_list [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:44:27.017470 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb16d92d-78b9-40bd-a8a7-6ff57dbb3a40 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.359217 Sep 13 16:44:27.018048 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1847/3682] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Sep 13 16:44:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:27.029590 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:27.030201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:27.036530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:27.037003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:27.037435 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:27.038113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:27.038558 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:27.039008 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:27.165418 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:27.174248 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebe18ab1-fe30-4ccc-ae2c-02d43819eb2c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1547 microversion: 2.1 time: 0.148465 Sep 13 16:44:27.174814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1836/3683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:27 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:28.717028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:28.720071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:28.726467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.726973 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.727408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.728080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.728525 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.728943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.968474 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93b9c9fa-537a-4e41-a929-dd74a78e0587 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255402 Sep 13 16:44:28.974994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1848/3684] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Sep 13 16:44:28 2022] POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:35.516826 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:35.518355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:35.524722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.525197 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.525625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.526300 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.526745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.527232 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.659730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:35.668423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec4ef906-14ad-418d-95a6-8e4a4c5117fd tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1593 microversion: 2.1 time: 0.155418 Sep 13 16:44:35.668978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1837/3685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:35 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:37.297492 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:37.301830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4160707a-49f7-41b9-a5b6-e62a4bde9379 req-5bbc8ace-85e0-4225-9526-cb5d1d8da77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:37.312479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4160707a-49f7-41b9-a5b6-e62a4bde9379 req-5bbc8ace-85e0-4225-9526-cb5d1d8da77d service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.313064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4160707a-49f7-41b9-a5b6-e62a4bde9379 req-5bbc8ace-85e0-4225-9526-cb5d1d8da77d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.313565 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4160707a-49f7-41b9-a5b6-e62a4bde9379 req-5bbc8ace-85e0-4225-9526-cb5d1d8da77d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.325523 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4160707a-49f7-41b9-a5b6-e62a4bde9379 req-5bbc8ace-85e0-4225-9526-cb5d1d8da77d service nova] Creating event network-changed:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:44:37.331848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4160707a-49f7-41b9-a5b6-e62a4bde9379 req-5bbc8ace-85e0-4225-9526-cb5d1d8da77d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Sep 13 16:44:37.332732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1849/3686] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:38.577431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1666404209"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:38.577993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:38.581178 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:38.587160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.587721 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.588163 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.588858 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.589313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.589743 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.594142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=67 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:38.724678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.network.security_group_api [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Adding security group f3eec0e4-5a4e-412d-af1a-88f9105cfe9c to port 59c69492-812b-495a-aa0a-12e25561ac01 Sep 13 16:44:39.040434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-024db550-1652-43b5-a52b-fc7c4f72dbd3 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/action" status: 202 len: 0 microversion: 2.1 time: 0.466887 Sep 13 16:44:39.042939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1838/3687] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:44:38 2022] POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:44:39.050930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:39.051741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:39.053674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:39.071127 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:39.071620 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:39.072060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:39.072763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:39.073218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:39.073645 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:39.077151 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:39.234315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:39.243283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87ff324e-32d5-4c15-bfae-0401566d1d55 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1759 microversion: 2.1 time: 0.197554 Sep 13 16:44:39.243783 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1850/3688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:39 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1759 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:39.347082 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-287b8302-acb1-4bd5-8dce-50382d1b903d req-0abdb963-0638-4194-9ed5-9edf1879435e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:39.356706 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-287b8302-acb1-4bd5-8dce-50382d1b903d req-0abdb963-0638-4194-9ed5-9edf1879435e service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:39.357276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-287b8302-acb1-4bd5-8dce-50382d1b903d req-0abdb963-0638-4194-9ed5-9edf1879435e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:39.357766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-287b8302-acb1-4bd5-8dce-50382d1b903d req-0abdb963-0638-4194-9ed5-9edf1879435e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:39.369476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-287b8302-acb1-4bd5-8dce-50382d1b903d req-0abdb963-0638-4194-9ed5-9edf1879435e service nova] Creating event network-changed:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:44:39.374470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-287b8302-acb1-4bd5-8dce-50382d1b903d req-0abdb963-0638-4194-9ed5-9edf1879435e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031696 Sep 13 16:44:39.375077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1839/3689] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:46.941203 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.941780 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.948025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.948496 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.948924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.949595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.950040 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.950458 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.976912 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:44:47.052966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3aeff527-b871-4a30-b884-d02d6a11630a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 204 len: 0 microversion: 2.1 time: 0.115612 Sep 13 16:44:47.053858 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1851/3690] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:46 2022] DELETE /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:44:47.067160 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:47.067865 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:47.075573 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.076054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.076517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.077180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.077627 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.078045 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.212931 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:47.221340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-430102a1-82d5-42ca-bda7-3482723cd49d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1576 microversion: 2.1 time: 0.162196 Sep 13 16:44:47.221967 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1840/3691] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:47 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:48.245391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:48.246001 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:48.252638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:48.253126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:48.253562 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:48.254257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:48.254709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:48.255160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:48.383877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:48.391493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d1581d6-3f78-419b-98d4-3aee294a756a tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1576 microversion: 2.1 time: 0.150375 Sep 13 16:44:48.392611 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1852/3692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:48 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:49.415314 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:49.417576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:49.425523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:49.426275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:49.426715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:49.427454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:49.427912 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:49.428341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:49.460758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-0bf33776-4ecb-4316-9d8b-5331578d4054 req-ff0bffa9-d600-4b8e-9910-808c9f3a124d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91b7693-40ea-4802-af89-489aa88bd4ca", "name": "network-vif-deleted", "tag": "8f950b6b-6ff6-4c03-9e25-d74cfa06c865"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:49.480500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0bf33776-4ecb-4316-9d8b-5331578d4054 req-ff0bffa9-d600-4b8e-9910-808c9f3a124d service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:49.481368 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0bf33776-4ecb-4316-9d8b-5331578d4054 req-ff0bffa9-d600-4b8e-9910-808c9f3a124d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:49.481970 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0bf33776-4ecb-4316-9d8b-5331578d4054 req-ff0bffa9-d600-4b8e-9910-808c9f3a124d service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:49.494822 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-0bf33776-4ecb-4316-9d8b-5331578d4054 req-ff0bffa9-d600-4b8e-9910-808c9f3a124d service nova] Creating event network-vif-deleted:8f950b6b-6ff6-4c03-9e25-d74cfa06c865 for instance b91b7693-40ea-4802-af89-489aa88bd4ca on hv-cinder-82002 Sep 13 16:44:49.500020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-0bf33776-4ecb-4316-9d8b-5331578d4054 req-ff0bffa9-d600-4b8e-9910-808c9f3a124d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044571 Sep 13 16:44:49.500803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1853/3693] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:49.513373 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:49.522257 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41eb1bee-0738-4b4b-ac48-64b74fa7faec tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 200 len: 1508 microversion: 2.1 time: 0.111155 Sep 13 16:44:49.535072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1841/3694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:49 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 1508 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:50.547413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:50.548715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:50.554803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.555328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.555762 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.556445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.556896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.557348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.571117 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] HTTP exception thrown: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Request method failure captured: Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca HTTP/1.1 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILLNN-U4XAei_Yng_n-QZPRmOiEDql80aC1gcfPPImtpCUb6iaSxrEmAqFUmPN1cSrCHkIvKg-KvStIoKmeAs_AFK1IsZc5VPec5fIGKjnQRMlwIvaMX76AF2ot91I52EP5DliH3VTJE2KKMKJcY7Z2m8Pk5fBq5QE8oVXP2gOUaVm8 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:44:50.572692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_02ef20a5c40945c688b9343861cadb85"}]}] Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-473989783 Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: b6417e189b0d467480627cfd38331a9f Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:44:50.574149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'b91b7693-40ea-4802-af89-489aa88bd4ca'} Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:50.575138 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:44:50.576493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:44:50.577697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Returning 404 to user: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:50.577697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee8e193b-d25c-4528-a977-8ebdd320d19b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 404 len: 111 microversion: 2.1 time: 0.031362 Sep 13 16:44:50.577697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1854/3695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:50 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:50.672681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1732008292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971711683", "security_groups": [{"name": "tempest-secgroup-smoke-1865310243"}], "block_device_mapping_v2": [{"uuid": "25862efd-49c9-4f3c-8942-543371e7f8cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4ea24ff-eba9-4b1b-b236-b6ed3f3d50d9"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:50.785689 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] validate_networks() for [('a4ea24ff-eba9-4b1b-b236-b6ed3f3d50d9', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:44:51.149902 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:44:51.150321 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:44:51.150814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:44:51.151258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:44:51.151665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:44:51.160396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.160869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.161330 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.162057 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.162492 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.162935 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.179235 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for project 02ef20a5c40945c688b9343861cadb85. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:51.183133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for user b6417e189b0d467480627cfd38331a9f and project 02ef20a5c40945c688b9343861cadb85. Resources: {'cores', 'ram', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:51.240063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:44:51.242280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25862efd-49c9-4f3c-8942-543371e7f8cf',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:44:51.375563 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3091a811-0b58-41d7-87a6-9dd2f095f0fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706660 Sep 13 16:44:51.376872 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1842/3696] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:44:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:44:51.388077 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6283213f-5290-4540-bfc8-1a3b98211148 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:51.388691 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6283213f-5290-4540-bfc8-1a3b98211148 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:51.443475 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6283213f-5290-4540-bfc8-1a3b98211148 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:51.450315 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6283213f-5290-4540-bfc8-1a3b98211148 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1094 microversion: 2.1 time: 0.066255 Sep 13 16:44:51.450873 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1855/3697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:51 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:52.474939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:52.476122 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:52.482144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.482622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.483261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.483952 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.484399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.484830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.571243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:52.579570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ba9142b-8f51-44a2-8832-d4f5a5c7ea74 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1210 microversion: 2.1 time: 0.109612 Sep 13 16:44:52.580584 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1843/3698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:52 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:53.602438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:53.603116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:53.610613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.611140 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.611894 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.612268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.612861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.613293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.799796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:53.807541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82301432-cec4-4393-b1bd-7fcc09764dde tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.208984 Sep 13 16:44:53.808106 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1856/3699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:53 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:53.837284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ed617a4c-57f9-4044-b369-a82eae23b279 req-87268ea7-dd63-4082-bd6d-e45a83c81a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1194dded-20ab-4b67-b5a2-cd714bc137ed", "tag": "07e5f6b4-51b5-4632-833a-2a590eb31df4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:53.848266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ed617a4c-57f9-4044-b369-a82eae23b279 req-87268ea7-dd63-4082-bd6d-e45a83c81a80 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.849067 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ed617a4c-57f9-4044-b369-a82eae23b279 req-87268ea7-dd63-4082-bd6d-e45a83c81a80 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.849571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ed617a4c-57f9-4044-b369-a82eae23b279 req-87268ea7-dd63-4082-bd6d-e45a83c81a80 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.861570 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ed617a4c-57f9-4044-b369-a82eae23b279 req-87268ea7-dd63-4082-bd6d-e45a83c81a80 service nova] Creating event network-changed:07e5f6b4-51b5-4632-833a-2a590eb31df4 for instance 1194dded-20ab-4b67-b5a2-cd714bc137ed on hv-cinder-82002 Sep 13 16:44:53.866526 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ed617a4c-57f9-4044-b369-a82eae23b279 req-87268ea7-dd63-4082-bd6d-e45a83c81a80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Sep 13 16:44:53.867262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1844/3700] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:54.832766 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:54.833607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:54.839964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.840443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.840877 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.841556 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.842002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.842421 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.036468 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:55.044683 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9407e8aa-5a35-42c8-a8a6-c17da35efdb2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.215802 Sep 13 16:44:55.045285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1857/3701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:54 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:56.068850 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:56.069546 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:56.075681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:56.076152 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:56.076581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:56.077252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:56.077697 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:56.078113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:56.210712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:56.218352 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-441caebb-262e-4d00-8f61-8c320da2634d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.154825 Sep 13 16:44:56.218934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1845/3702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:56 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:57.241223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:57.241831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:57.248255 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:57.248741 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:57.249182 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:57.249869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:57.250328 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:57.251331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:57.378321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:57.385851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-109c0b08-a37e-49bb-a440-534fc056e60d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.148552 Sep 13 16:44:57.386407 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1858/3703] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:57 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:58.409425 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:58.410035 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:58.416554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.417032 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.417467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.418159 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.418611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.419059 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.548757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:58.556547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35bbb1af-8475-4f98-9e2e-23f06f171ddc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.151627 Sep 13 16:44:58.557117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1846/3704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:58 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:59.579971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:59.580828 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:59.587316 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:59.587802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:59.588239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.588926 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:59.589387 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:59.589816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.723564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:59.731134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eff4de00-523b-4ec9-9dd5-c9c3c6994d24 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.154972 Sep 13 16:44:59.731688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1859/3705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:59 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:00.753483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:00.754088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:00.760396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:00.761132 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:00.761569 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:00.762245 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:00.762699 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:00.763134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:00.892853 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:00.901070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8cf23e9-1221-40a1-9dd3-1ba3332a6f0f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.151559 Sep 13 16:45:00.901626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1847/3706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:00 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:01.538787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:01.541009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:01.543471 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:01.548834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.549314 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.549753 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.550442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.550915 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.551339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.620898 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54cd8a16-7a7c-495b-b36c-12882802d583 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/action" status: 202 len: 0 microversion: 2.1 time: 0.085835 Sep 13 16:45:01.621546 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1860/3707] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:45:01 2022] POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:45:01.632403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:01.633156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:01.635144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:01.635873 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:01.644863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.645836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.646277 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.647001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.647454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.647878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.879836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:01.888451 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee2e5590-342d-4ab5-8824-317dc0786cc5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1751 microversion: 2.1 time: 0.262353 Sep 13 16:45:01.889581 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1848/3708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:01 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:01.926253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:01.927123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:01.933223 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.933703 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.934141 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.934824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.935308 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.935734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.400561 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:02.409004 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10cd967f-b93c-418c-aef1-d011f835fdb9 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.487388 Sep 13 16:45:02.409564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1861/3709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:01 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:02.912798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:02.913412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:02.920205 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.920667 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.921093 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.921773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.922219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.922639 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.088548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:03.096877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8bceca5e-893e-421b-8be8-cfdfcbb38aa5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.187888 Sep 13 16:45:03.097437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1849/3710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:02 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:03.432160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:03.432775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:03.439776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:03.440251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:03.440685 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.441373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:03.441824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:03.442248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.569715 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:03.577297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb6ad683-c02a-47fd-af79-08c2ba99c75d tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.148984 Sep 13 16:45:03.577848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1862/3711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:03 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:04.121191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:04.121824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:04.128399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.128876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.129307 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.129981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.130424 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.130842 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.274200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:04.282210 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-183222d9-347f-45f5-b0de-e109fa7a34bc tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.164962 Sep 13 16:45:04.283480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1850/3712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:04 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:04.600378 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:04.601671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:04.608692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.609172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.609603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.610318 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.610802 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.611251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.716244 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-a82506e1-40e7-4d86-93d5-06a7dc90a47c req-308afd04-c119-42bd-8bad-374ccde26bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1194dded-20ab-4b67-b5a2-cd714bc137ed", "name": "network-vif-plugged", "status": "completed", "tag": "07e5f6b4-51b5-4632-833a-2a590eb31df4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:04.728209 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a82506e1-40e7-4d86-93d5-06a7dc90a47c req-308afd04-c119-42bd-8bad-374ccde26bb4 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.729252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a82506e1-40e7-4d86-93d5-06a7dc90a47c req-308afd04-c119-42bd-8bad-374ccde26bb4 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.729703 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a82506e1-40e7-4d86-93d5-06a7dc90a47c req-308afd04-c119-42bd-8bad-374ccde26bb4 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.741046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-a82506e1-40e7-4d86-93d5-06a7dc90a47c req-308afd04-c119-42bd-8bad-374ccde26bb4 service nova] Creating event network-vif-plugged:07e5f6b4-51b5-4632-833a-2a590eb31df4 for instance 1194dded-20ab-4b67-b5a2-cd714bc137ed on hv-cinder-82002 Sep 13 16:45:04.746876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-a82506e1-40e7-4d86-93d5-06a7dc90a47c req-308afd04-c119-42bd-8bad-374ccde26bb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033705 Sep 13 16:45:04.747705 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1851/3713] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:04.748602 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:04.757180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1fa7e160-270b-4dc5-8d10-93e941527c80 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.160993 Sep 13 16:45:04.758098 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1863/3714] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:04 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:05.306436 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:05.307075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:05.313211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.313735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.314261 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.314951 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.315412 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.315840 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.457131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:05.465181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67b4c900-4fa0-43ce-8fd0-304e77b800b2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.163454 Sep 13 16:45:05.465739 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1852/3715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:05 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:05.780327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:05.780928 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:05.788443 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.788918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.789353 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.790030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.790478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.790914 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.918830 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:05.926667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4778ccdd-e6c9-456e-8127-820a2ffc6ef1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1266 microversion: 2.1 time: 0.150103 Sep 13 16:45:05.927286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1864/3716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:05 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:06.489467 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:06.490097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:06.496676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:06.497193 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:06.497664 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:06.498362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:06.498819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:06.499305 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:06.643185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:06.651345 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d62e6ad-922c-4759-aca7-a400d8c4aea5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.166303 Sep 13 16:45:06.651909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1853/3717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:06 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:06.949601 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:06.950242 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:06.957840 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:06.958576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:06.959177 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:06.960060 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:06.960505 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:06.960927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.093047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:07.101307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43d93ab1-3694-4521-b9e7-08c1098904d2 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1453 microversion: 2.1 time: 0.155542 Sep 13 16:45:07.101870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1865/3718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:06 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:07.123128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:07.123745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:07.129843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.130416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.130862 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.131577 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.132459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.132459 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.263676 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:07.272106 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f116d2a2-9a5d-41c6-9c2e-187726c0d1c1 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1453 microversion: 2.1 time: 0.152904 Sep 13 16:45:07.272665 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1854/3719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:07 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:07.676069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:07.677010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:07.683866 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.684440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.684917 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.685760 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.686253 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.686686 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.702464 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:07.935161 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:07.951994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6468558d-f5e9-40f7-865c-5af47741c183 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.281853 Sep 13 16:45:07.970994 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1866/3720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:07 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:08.931971 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-5896b742-45a4-4536-8953-4b39cc1d3666 req-c48dcc7a-c575-41d4-9830-722b4db9be9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1194dded-20ab-4b67-b5a2-cd714bc137ed", "tag": "07e5f6b4-51b5-4632-833a-2a590eb31df4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:08.937735 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:08.945337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5896b742-45a4-4536-8953-4b39cc1d3666 req-c48dcc7a-c575-41d4-9830-722b4db9be9b service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.946222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5896b742-45a4-4536-8953-4b39cc1d3666 req-c48dcc7a-c575-41d4-9830-722b4db9be9b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.946740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5896b742-45a4-4536-8953-4b39cc1d3666 req-c48dcc7a-c575-41d4-9830-722b4db9be9b service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.951208 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:08.962099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-5896b742-45a4-4536-8953-4b39cc1d3666 req-c48dcc7a-c575-41d4-9830-722b4db9be9b service nova] Creating event network-changed:07e5f6b4-51b5-4632-833a-2a590eb31df4 for instance 1194dded-20ab-4b67-b5a2-cd714bc137ed on hv-cinder-82002 Sep 13 16:45:08.967555 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-5896b742-45a4-4536-8953-4b39cc1d3666 req-c48dcc7a-c575-41d4-9830-722b4db9be9b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039134 Sep 13 16:45:08.968156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1855/3721] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:08.980612 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:08.981811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:08.988575 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.989097 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.989497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.990295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.990635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.991104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:09.216813 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:09.225551 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb641cb5-ceaf-4bd8-92c5-6bfb1b3603ad tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.248907 Sep 13 16:45:09.226460 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1867/3722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:08 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:10.249404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:10.250102 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:10.256295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.256772 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.257206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.257921 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.258369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.258793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.402423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:10.411220 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4524b155-af27-4654-a4ec-4ee625ec80a5 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.166441 Sep 13 16:45:10.411793 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1856/3723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:10 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:11.434441 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:11.435079 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:11.436981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:11.442473 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.442979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.443415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:11.444095 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.444538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.444955 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:11.584055 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:11.592050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d5cb811-ec38-4523-8503-1a81c668f0cb tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.161572 Sep 13 16:45:11.592597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1868/3724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:11 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:12.615298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:12.615949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:12.622493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.623002 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.623441 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.624156 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.624608 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.625034 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.767888 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:12.776083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b94b2f30-bbb8-459c-b951-271fb4d79644 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.164614 Sep 13 16:45:12.776638 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1857/3725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:12 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:13.800268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:13.800815 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:13.807136 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.807613 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.808049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.808723 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.809172 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.809593 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.947362 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:13.956174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46ee6500-8ad2-4a99-b27a-05abc3801d9c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.160472 Sep 13 16:45:13.957709 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1869/3726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:13 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:14.981169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:14.981776 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:14.989306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:14.989787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:14.990225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:14.990939 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:14.991422 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:14.991844 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:15.138091 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:15.146549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d272bc23-a998-41a5-acee-d92101987f77 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.169321 Sep 13 16:45:15.147138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1858/3727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:14 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:16.170283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:16.170881 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:16.177776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:16.178268 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:16.178712 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:16.179442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:16.179900 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:16.180327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:16.320769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:16.329520 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58e63ea2-5bbc-4d44-9da7-18157d0ff90c tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.162618 Sep 13 16:45:16.330123 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1870/3728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:16 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:17.353536 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:17.354150 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:17.361213 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:17.361695 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:17.362130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:17.362823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:17.363299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:17.363730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:17.504622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:17.512832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c59818e-e878-47e9-85ed-7c9579cb20d2 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.163131 Sep 13 16:45:17.513401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1859/3729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:17 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:18.537472 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:18.538087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:18.544718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.545201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.545638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.546325 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.546775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.547238 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.700099 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:18.709311 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7e60b97-b813-4b5e-9269-ebf39ce4a86e tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1756 microversion: 2.1 time: 0.175729 Sep 13 16:45:18.709882 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1871/3730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:18 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:19.732072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:19.732684 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:19.739712 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:19.740190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:19.740629 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:19.741315 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:19.741766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:19.742189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:19.883202 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:19.891258 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac6bfe47-00eb-4ff1-b7ef-952b645677a4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1759 microversion: 2.1 time: 0.163003 Sep 13 16:45:19.892324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1860/3731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:19 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:36.702750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.703331 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:36.706086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=7 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:36.706730 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=33 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:36.712348 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.712895 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.713327 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.714009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.714456 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.714875 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.728821 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] HTTP exception thrown: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Request method failure captured: Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 HTTP/1.1 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqr_wzJ3QqLMnZyN4RE9Ul67qOjW9B4cekciEvaENRVAe1SfUCRQWJGfCAouEMWBuZOAOBTVPWSpTDI0UqENtGeP3PboR_fxVwPpW5981r26RH0sBM601RIF6yF_UDqAFf1ybD1bL64kJnRrniQ3E61VveIEkn08pr0Q2IiT7L5BdE Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:45:36.730480 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_859cfa45a18845f49e525ab4ed54b529"}]}] Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: c0fd4bbe430b4a8888f3be4b23982c5a Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.732003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '0ad470a6-0ff7-41e3-a0d0-887c468ce0b6'} Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:36.732776 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.734299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.736056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Returning 404 to user: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:36.736056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-112eea25-3e8f-4890-b527-a1587e92ef3a tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 404 len: 111 microversion: 2.20 time: 0.033119 Sep 13 16:45:36.736056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1872/3732] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Sep 13 16:45:36 2022] DELETE /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:36.738138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=11 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:36.738881 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=31 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:36.742863 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.743497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:36.750080 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.750560 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.751030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.751714 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.752182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.752592 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.765737 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] HTTP exception thrown: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Request method failure captured: Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 HTTP/1.1 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKqr_wzJ3QqLMnZyN4RE9Ul67qOjW9B4cekciEvaENRVAe1SfUCRQWJGfCAouEMWBuZOAOBTVPWSpTDI0UqENtGeP3PboR_fxVwPpW5981r26RH0sBM601RIF6yF_UDqAFf1ybD1bL64kJnRrniQ3E61VveIEkn08pr0Q2IiT7L5BdE Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:45:36.767407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_859cfa45a18845f49e525ab4ed54b529"}]}] Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: c0fd4bbe430b4a8888f3be4b23982c5a Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.769051 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '0ad470a6-0ff7-41e3-a0d0-887c468ce0b6'} Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:36.769983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. Sep 13 16:45:36.771100 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.772154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Returning 404 to user: Instance 0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:36.772154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b04a6fc6-7752-45ce-b6e7-400ea23b7b42 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6" status: 404 len: 111 microversion: 2.20 time: 0.032384 Sep 13 16:45:36.772154 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1861/3733] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers/0ad470a6-0ff7-41e3-a0d0-887c468ce0b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:37.906279 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:37.906784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:37.913442 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.913929 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.914369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.915101 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.915554 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.916003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.929746 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] HTTP exception thrown: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Request method failure captured: Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 HTTP/1.1 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjIKqr_wzJ3QqLMnZyN4RE9Ul67qOjW9B4cekciEvaENRVAe1SfUCRQWJGfCAouEMWBuZOAOBTVPWSpTDI0UqENtGeP3PboR_fxVwPpW5981r26RH0sBM601RIF6yF_UDqAFf1ybD1bL64kJnRrniQ3E61VveIEkn08pr0Q2IiT7L5BdE Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:45:37.931357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_859cfa45a18845f49e525ab4ed54b529"}]}] Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: c0fd4bbe430b4a8888f3be4b23982c5a Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.932832 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': '1e10547c-b6b5-4dec-a8c7-3c411ac06e68'} Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:37.933674 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.935103 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.936639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Returning 404 to user: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:37.936639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10d7ef0e-83ec-424d-a04d-a7e28ac32f08 tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 404 len: 111 microversion: 2.20 time: 0.030291 Sep 13 16:45:37.936639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1873/3734] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Sep 13 16:45:37 2022] DELETE /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:37.941671 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:37.942280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] [instance: 1e10547c-b6b5-4dec-a8c7-3c411ac06e68] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:37.948679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.949157 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.949602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.950280 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.950730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.951186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.964985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] HTTP exception thrown: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Request method failure captured: Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 HTTP/1.1 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjIKqr_wzJ3QqLMnZyN4RE9Ul67qOjW9B4cekciEvaENRVAe1SfUCRQWJGfCAouEMWBuZOAOBTVPWSpTDI0UqENtGeP3PboR_fxVwPpW5981r26RH0sBM601RIF6yF_UDqAFf1ybD1bL64kJnRrniQ3E61VveIEkn08pr0Q2IiT7L5BdE Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:45:37.966448 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/859cfa45a18845f49e525ab4ed54b529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_859cfa45a18845f49e525ab4ed54b529"}]}] Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 859cfa45a18845f49e525ab4ed54b529 Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060503295 Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: c0fd4bbe430b4a8888f3be4b23982c5a Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060503295-project Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.967950 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '1e10547c-b6b5-4dec-a8c7-3c411ac06e68'} Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:37.968827 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. Sep 13 16:45:37.970170 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:37.971360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] Returning 404 to user: Instance 1e10547c-b6b5-4dec-a8c7-3c411ac06e68 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:37.971360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-800ca2dd-dfb5-4efe-8fea-7486a51033ea tempest-AttachVolumeShelveTestJSON-1060503295 tempest-AttachVolumeShelveTestJSON-1060503295-project] 10.222.0.50 "GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68" status: 404 len: 111 microversion: 2.20 time: 0.030709 Sep 13 16:45:37.971360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1862/3735] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:37 2022] GET /compute/v2.1/servers/1e10547c-b6b5-4dec-a8c7-3c411ac06e68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:43.663247 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1214282e-d8ee-4925-b60a-c25c371b6c8f tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67d666f70>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:43.709898 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1214282e-d8ee-4925-b60a-c25c371b6c8f tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c3a76168-ea7a-4d6d-b3d3-946628275c67" status: 200 len: 351 microversion: 2.1 time: 0.050609 Sep 13 16:45:43.710463 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1874/3736] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:45:43 2022] GET /compute/v2.1/os-volumes/c3a76168-ea7a-4d6d-b3d3-946628275c67 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:45.040204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-454b4fc0-4063-4aa0-b496-1223c8f0d672 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67fa01790>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:45.088010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-454b4fc0-4063-4aa0-b496-1223c8f0d672 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d2652471-80f1-4750-a8d7-588c8555c5d8" status: 200 len: 351 microversion: 2.1 time: 0.051604 Sep 13 16:45:45.088565 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1863/3737] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:45:45 2022] GET /compute/v2.1/os-volumes/d2652471-80f1-4750-a8d7-588c8555c5d8 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:46.426714 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbb442bc-ce3f-47ce-b4ff-61bc49997a7b tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67c306af0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.472538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbb442bc-ce3f-47ce-b4ff-61bc49997a7b tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c247c862-8363-4088-9e48-e3b09cfced6b" status: 200 len: 350 microversion: 2.1 time: 0.050770 Sep 13 16:45:46.473126 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1875/3738] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes/c247c862-8363-4088-9e48-e3b09cfced6b => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:46.486133 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9641f72-4350-4d7c-987a-045007caddc0 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67fa23790>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.570055 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9641f72-4350-4d7c-987a-045007caddc0 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087992 Sep 13 16:45:46.570630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1864/3739] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:46.585372 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f285775-b090-498a-a137-cdbd16368946 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67c494f70>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.668056 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f285775-b090-498a-a137-cdbd16368946 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086414 Sep 13 16:45:46.668888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1876/3740] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:46.683433 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-836d9c3d-71d4-48a2-b435-3e9e78d4b51f tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67c14f820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.764549 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-836d9c3d-71d4-48a2-b435-3e9e78d4b51f tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084716 Sep 13 16:45:46.765243 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1865/3741] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:46.778836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a447dd60-4079-4436-a6b7-239e0c4b0cc6 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67fa89dc0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.868399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a447dd60-4079-4436-a6b7-239e0c4b0cc6 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092140 Sep 13 16:45:46.868399 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1877/3742] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:46.881503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17d2dd9f-83ce-446e-bc25-b913c8736d62 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67fa93280>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.964490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17d2dd9f-83ce-446e-bc25-b913c8736d62 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086868 Sep 13 16:45:46.965053 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1866/3743] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:46.979202 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-325981d0-0c3f-4a97-afcb-f4bd170f6a98 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67c0f2af0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:47.059911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-325981d0-0c3f-4a97-afcb-f4bd170f6a98 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084430 Sep 13 16:45:47.060498 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1878/3744] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:47.073748 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07452b7f-876f-40dd-a37b-abc4588a424e tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67facd820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:47.155431 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07452b7f-876f-40dd-a37b-abc4588a424e tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085337 Sep 13 16:45:47.156013 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1867/3745] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Sep 13 16:45:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:47.169943 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a9c37d6-a1ff-4c5c-830d-aad6de2be885 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] Calling method '.version_select at 0x7fb67c2bee50>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:47.253438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a9c37d6-a1ff-4c5c-830d-aad6de2be885 tempest-VolumesTestJSON-1441587356 tempest-VolumesTestJSON-1441587356-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087196 Sep 13 16:45:47.254086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1879/3746] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Sep 13 16:45:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:51.903324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:51.904061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:52.021831 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5a7b6f4-ae45-496b-9006-be301b454ae3 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Action: 'create', calling method: .version_select at 0x7fb67c146dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1326176722", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5a7b6f4-ae45-496b-9006-be301b454ae3 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Request method failure captured: Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 122 Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILO_xgdHvFkKJnTVYi8TSwyIkVGHzf20lPaSZ8sUNZf12lwTDRltwlVSOuEFtmVbZwA1K_UkUPYPaT6sJqs_8-0w1K7tgMlQuZ919g6zDvnqHbDBHk6hTUHOCQLdxENmrQbU4fgkRD0UZzxgK6Hb1EIXGY-6h4-zNfC9u_geBjzoz2Y Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:45:52.035415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd3a7ff18c784b09be4eebe9358046d0"}]}] Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 8b2c4c17dc1a46c285bd6771267e9f67 Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1326176722", "metadata": {"Type": "work"}}} Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: Sep 13 16:45:52.036909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1326176722', 'metadata': {'Type': 'work'}}}} Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:52.037855 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:45:52.039256 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:45:52.040342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 16:45:52.040342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.040342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5a7b6f4-ae45-496b-9006-be301b454ae3 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:52.040342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5a7b6f4-ae45-496b-9006-be301b454ae3 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134659 Sep 13 16:45:52.040342 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1868/3747] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Sep 13 16:45:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:52.044002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:52.045199 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:52.046662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:45:52.046817 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Tue Sep 13 16:45:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.50) !!! Sep 13 16:45:52.051584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abad0d53-64a3-4e3e-8c31-f61439d3001f tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Action: 'create', calling method: .version_select at 0x7fb67c3944c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-574236767", "metadata": {"Type": "work"}}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abad0d53-64a3-4e3e-8c31-f61439d3001f tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Request method failure captured: Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 119 Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILO_xgdHvFkKJnTVYi8TSwyIkVGHzf20lPaSZ8sUNZf12lwTDRltwlVSOuEFtmVbZwA1K_UkUPYPaT6sJqs_8-0w1K7tgMlQuZ919g6zDvnqHbDBHk6hTUHOCQLdxENmrQbU4fgkRD0UZzxgK6Hb1EIXGY-6h4-zNfC9u_geBjzoz2Y Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:45:52.056069 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd3a7ff18c784b09be4eebe9358046d0"}]}] Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 8b2c4c17dc1a46c285bd6771267e9f67 Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-574236767", "metadata": {"Type": "work"}}} Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: Sep 13 16:45:52.057491 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-574236767', 'metadata': {'Type': 'work'}}}} Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi '0' Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:52.058306 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:45:52.059639 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:45:52.060744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 16:45:52.060744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.060744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abad0d53-64a3-4e3e-8c31-f61439d3001f tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:52.060744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abad0d53-64a3-4e3e-8c31-f61439d3001f tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014569 Sep 13 16:45:52.060744 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1880/3748] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Sep 13 16:45:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:45:52.068121 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-050db15e-deac-4898-b0de-b5283f29ca04 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Action: 'create', calling method: .version_select at 0x7fb67c14f550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1126538457", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-050db15e-deac-4898-b0de-b5283f29ca04 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Request method failure captured: Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 119 Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILO_xgdHvFkKJnTVYi8TSwyIkVGHzf20lPaSZ8sUNZf12lwTDRltwlVSOuEFtmVbZwA1K_UkUPYPaT6sJqs_8-0w1K7tgMlQuZ919g6zDvnqHbDBHk6hTUHOCQLdxENmrQbU4fgkRD0UZzxgK6Hb1EIXGY-6h4-zNfC9u_geBjzoz2Y Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:45:52.071700 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd3a7ff18c784b09be4eebe9358046d0"}]}] Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 8b2c4c17dc1a46c285bd6771267e9f67 Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1126538457", "metadata": {"Type": "work"}}} Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: Sep 13 16:45:52.073462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1126538457', 'metadata': {'Type': 'work'}}}} Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi '' Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:52.074369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:45:52.075948 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:45:52.076983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 16:45:52.076983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.076983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-050db15e-deac-4898-b0de-b5283f29ca04 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:52.076983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-050db15e-deac-4898-b0de-b5283f29ca04 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009608 Sep 13 16:45:52.076983 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1869/3749] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Sep 13 16:45:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:52.085210 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c8d5ba2-68d4-48ee-96f2-13173bbaa03b tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Calling method '.version_select at 0x7fb67d6a4700>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:52.113954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-4c8d5ba2-68d4-48ee-96f2-13173bbaa03b tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] HTTP exception thrown: Volume tempest-invalid-1310999359 could not be found. Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c8d5ba2-68d4-48ee-96f2-13173bbaa03b tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Request method failure captured: Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1310999359 HTTP/1.1 Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILO_xgdHvFkKJnTVYi8TSwyIkVGHzf20lPaSZ8sUNZf12lwTDRltwlVSOuEFtmVbZwA1K_UkUPYPaT6sJqs_8-0w1K7tgMlQuZ919g6zDvnqHbDBHk6hTUHOCQLdxENmrQbU4fgkRD0UZzxgK6Hb1EIXGY-6h4-zNfC9u_geBjzoz2Y Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:45:52.115992 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd3a7ff18c784b09be4eebe9358046d0"}]}] Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 8b2c4c17dc1a46c285bd6771267e9f67 Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Volume tempest-invalid-1310999359 could not be found. Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'tempest-invalid-1310999359'} Sep 13 16:45:52.117494 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1310999359 could not be found. (HTTP 404) (Request-ID: req-9a5ad0d8-2566-4658-b673-6c653b11d319) Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.118417 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 16:45:52.119784 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1310999359 could not be found. Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:52.121218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1310999359 could not be found. Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1310999359 could not be found. Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c8d5ba2-68d4-48ee-96f2-13173bbaa03b tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Returning 404 to user: Volume tempest-invalid-1310999359 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c8d5ba2-68d4-48ee-96f2-13173bbaa03b tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1310999359" status: 404 len: 99 microversion: 2.1 time: 0.038903 Sep 13 16:45:52.122415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1881/3750] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Sep 13 16:45:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1310999359 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:45:52.127089 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1ba9460-c252-4b5b-8f44-371f3e5edd97 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003820 Sep 13 16:45:52.127580 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1870/3751] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Sep 13 16:45:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 16:45:52.135963 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50c54e73-e62e-481a-904e-7bcac7aaf1bb tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003692 Sep 13 16:45:52.136450 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1882/3752] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Sep 13 16:45:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 16:45:52.144984 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5da8e32a-5c60-4ec5-98e8-64ddedece625 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Calling method '.version_select at 0x7fb67c146310>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:52.162094 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1666404209"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:52.162627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:52.170196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.170682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.171343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.171911 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.172373 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.172835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.174231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-5da8e32a-5c60-4ec5-98e8-64ddedece625 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] HTTP exception thrown: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5da8e32a-5c60-4ec5-98e8-64ddedece625 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Request method failure captured: Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/os-volumes/2a7d9b15-8b95-4402-8382-8c8e88237ae1 HTTP/1.1 Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILO_xgdHvFkKJnTVYi8TSwyIkVGHzf20lPaSZ8sUNZf12lwTDRltwlVSOuEFtmVbZwA1K_UkUPYPaT6sJqs_8-0w1K7tgMlQuZ919g6zDvnqHbDBHk6hTUHOCQLdxENmrQbU4fgkRD0UZzxgK6Hb1EIXGY-6h4-zNfC9u_geBjzoz2Y Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:45:52.176423 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd3a7ff18c784b09be4eebe9358046d0"}]}] Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 8b2c4c17dc1a46c285bd6771267e9f67 Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '2a7d9b15-8b95-4402-8382-8c8e88237ae1'} Sep 13 16:45:52.177622 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. (HTTP 404) (Request-ID: req-e9862d56-6a92-49e1-becc-79336bcdff9b) Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.178672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 16:45:52.179854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 16:45:52.180962 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5da8e32a-5c60-4ec5-98e8-64ddedece625 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Returning 404 to user: Volume 2a7d9b15-8b95-4402-8382-8c8e88237ae1 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5da8e32a-5c60-4ec5-98e8-64ddedece625 tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/2a7d9b15-8b95-4402-8382-8c8e88237ae1" status: 404 len: 109 microversion: 2.1 time: 0.037003 Sep 13 16:45:52.182194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1871/3753] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Sep 13 16:45:52 2022] DELETE /compute/v2.1/os-volumes/2a7d9b15-8b95-4402-8382-8c8e88237ae1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:52.187770 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e7ea53d-e122-486e-90a9-4b4487255c9a tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Calling method '.version_select at 0x7fb67c14faf0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:52.216222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-6e7ea53d-e122-486e-90a9-4b4487255c9a tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] HTTP exception thrown: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e7ea53d-e122-486e-90a9-4b4487255c9a tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Request method failure captured: Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/5cc8c9b1-2652-419d-8b02-0de501d47609 HTTP/1.1 Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILO_xgdHvFkKJnTVYi8TSwyIkVGHzf20lPaSZ8sUNZf12lwTDRltwlVSOuEFtmVbZwA1K_UkUPYPaT6sJqs_8-0w1K7tgMlQuZ919g6zDvnqHbDBHk6hTUHOCQLdxENmrQbU4fgkRD0UZzxgK6Hb1EIXGY-6h4-zNfC9u_geBjzoz2Y Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:45:52.218185 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bd3a7ff18c784b09be4eebe9358046d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bd3a7ff18c784b09be4eebe9358046d0"}]}] Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: bd3a7ff18c784b09be4eebe9358046d0 Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1253517592 Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 8b2c4c17dc1a46c285bd6771267e9f67 Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1253517592-project Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '5cc8c9b1-2652-419d-8b02-0de501d47609'} Sep 13 16:45:52.219670 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. (HTTP 404) (Request-ID: req-c3485acf-8821-4ede-af87-841a2b5d0786) Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.220576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:45:52.222542 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 16:45:52.223866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e7ea53d-e122-486e-90a9-4b4487255c9a tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] Returning 404 to user: Volume 5cc8c9b1-2652-419d-8b02-0de501d47609 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e7ea53d-e122-486e-90a9-4b4487255c9a tempest-VolumesNegativeTest-1253517592 tempest-VolumesNegativeTest-1253517592-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5cc8c9b1-2652-419d-8b02-0de501d47609" status: 404 len: 109 microversion: 2.1 time: 0.036247 Sep 13 16:45:52.224943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1872/3754] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Sep 13 16:45:52 2022] GET /compute/v2.1/os-volumes/5cc8c9b1-2652-419d-8b02-0de501d47609 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:52.305816 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.network.security_group_api [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Removing security group f3eec0e4-5a4e-412d-af1a-88f9105cfe9c from port 59c69492-812b-495a-aa0a-12e25561ac01 Sep 13 16:45:52.629860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8f81a2a-9b34-4b1a-a837-c30bd3dc50ce tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/action" status: 202 len: 0 microversion: 2.1 time: 0.472480 Sep 13 16:45:52.630705 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1883/3755] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:45:52 2022] POST /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:45:52.639182 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-447b1ca2-4e76-4399-839d-2d70609f5aff req-3f57a6de-5278-4be0-889b-8848db7e36ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:52.665965 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-447b1ca2-4e76-4399-839d-2d70609f5aff req-3f57a6de-5278-4be0-889b-8848db7e36ce service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.666446 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-447b1ca2-4e76-4399-839d-2d70609f5aff req-3f57a6de-5278-4be0-889b-8848db7e36ce service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.667095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-447b1ca2-4e76-4399-839d-2d70609f5aff req-3f57a6de-5278-4be0-889b-8848db7e36ce service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.685162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-447b1ca2-4e76-4399-839d-2d70609f5aff req-3f57a6de-5278-4be0-889b-8848db7e36ce service nova] Creating event network-changed:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:45:52.700174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-447b1ca2-4e76-4399-839d-2d70609f5aff req-3f57a6de-5278-4be0-889b-8848db7e36ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064726 Sep 13 16:45:52.700901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1873/3756] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:54.147285 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:54.147803 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:54.154070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.154557 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.155024 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.155718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.156176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.156605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.248447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lazy-loading 'services' on Instance uuid 370b9026-ea37-453f-8f94-7e871bc8dd0b {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:54.333449 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8eb9cf6c-e1d8-49dd-803a-f8d17ccc1e34 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments/c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa" status: 202 len: 0 microversion: 2.1 time: 0.190823 Sep 13 16:45:54.334386 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1884/3757] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:45:54 2022] DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments/c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:45:54.344364 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:54.347517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:54.354764 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.355537 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.356221 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.357609 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.358340 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.358823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.404151 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79cec2bc-8348-4ba8-b0fd-2d0c9cf641d7 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064484 Sep 13 16:45:54.404747 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1874/3758] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:45:54 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:54.717156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-e24997a9-ca22-4f49-a317-21f108b4c05d req-7eb12f94-5b0a-4c42-a915-ac1f8af8b9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:54.728769 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e24997a9-ca22-4f49-a317-21f108b4c05d req-7eb12f94-5b0a-4c42-a915-ac1f8af8b9c5 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.729374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e24997a9-ca22-4f49-a317-21f108b4c05d req-7eb12f94-5b0a-4c42-a915-ac1f8af8b9c5 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.729974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e24997a9-ca22-4f49-a317-21f108b4c05d req-7eb12f94-5b0a-4c42-a915-ac1f8af8b9c5 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.743006 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-e24997a9-ca22-4f49-a317-21f108b4c05d req-7eb12f94-5b0a-4c42-a915-ac1f8af8b9c5 service nova] Creating event network-changed:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:45:54.748219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-e24997a9-ca22-4f49-a317-21f108b4c05d req-7eb12f94-5b0a-4c42-a915-ac1f8af8b9c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035122 Sep 13 16:45:54.748793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1885/3759] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:55.416978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:55.419138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:55.426199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.426679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.427149 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.427820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.428266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.428686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.457860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3fb4b65-387c-464e-b0f2-b59683a7f82d tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044973 Sep 13 16:45:55.458404 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1875/3760] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Sep 13 16:45:55 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:55.469334 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:55.470029 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:55.476607 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.477090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.477528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.478232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.478669 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.479128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.553599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] HTTP exception thrown: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b is not attached to volume c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Request method failure captured: Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments/c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa HTTP/1.1 Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILNJ_Ftfj00JcFYdJxMyCu-XO_vZ65tAxWWTPJcCQ0eFKX9WsjfVXK69tg7dnVYbWrlLJWV0_TnePXZxHspoQUPj9E7OStHUbLmi9cJp5OFMM-UnCVlPS8ObgVBjMWSJXlBYrochtdPFfCfZaDo5jYvqAAn2DiFdQwiO9xhq48HFnMw Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 08f6037f42c34be7b2407c258d8885be Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestMinimumBasicScenario-1135526430 Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:45:55.555956 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/08f6037f42c34be7b2407c258d8885be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/08f6037f42c34be7b2407c258d8885be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/08f6037f42c34be7b2407c258d8885be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_08f6037f42c34be7b2407c258d8885be"}]}] Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestMinimumBasicScenario-1135526430 Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 08f6037f42c34be7b2407c258d8885be Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1135526430 Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-TestMinimumBasicScenario-1135526430-project Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: 91ce9cad1eab41efb4da9503c23ad073 Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestMinimumBasicScenario-1135526430-project Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:45:55.557537 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b is not attached to volume c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '370b9026-ea37-453f-8f94-7e871bc8dd0b', 'id': 'c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa'} Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa. Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:55.558233 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b is not attached to volume c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b is not attached to volume c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:45:55.559871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Returning 404 to user: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b is not attached to volume c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:55.561109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf739411-0f66-443b-9028-845faec5cc03 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments/c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa" status: 404 len: 154 microversion: 2.1 time: 0.092548 Sep 13 16:45:55.561109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1886/3761] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Sep 13 16:45:55 2022] DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b/os-volume_attachments/c3779fef-9e15-4f09-9b5d-fa2bc3cd32fa => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:56.700272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:56.700780 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:56.707438 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.707920 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.708360 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.709047 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.709497 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.709929 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.733669 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:56.809403 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3d7770c-130b-44ce-9b90-a60f38ebd307 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 204 len: 0 microversion: 2.1 time: 0.112647 Sep 13 16:45:56.809936 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1876/3762] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:56 2022] DELETE /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:45:56.819351 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:56.819964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:56.826572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.827086 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.827514 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.828191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.828640 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.829057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.960743 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:56.968509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-29210a40-362b-4791-b6ce-8c3a8bbfa722 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1553 microversion: 2.1 time: 0.154019 Sep 13 16:45:56.969066 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1887/3763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:56 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:57.993532 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:57.994228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:58.000614 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:58.001129 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:58.001564 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:58.002238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:58.002682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:58.003137 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:58.130728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:58.138350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88bb17c1-9a71-477b-967b-d2f2466ad619 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1553 microversion: 2.1 time: 0.148987 Sep 13 16:45:58.138917 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1877/3764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:57 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:59.162599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.163438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.171614 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.172107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.173088 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.174748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.174834 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.175284 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.231509 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-5c3085db-7ad6-40e2-9212-cd5ae04b38ce req-752d1f46-b06d-4de2-9ea1-e8aeeef6d404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370b9026-ea37-453f-8f94-7e871bc8dd0b", "name": "network-vif-deleted", "tag": "59c69492-812b-495a-aa0a-12e25561ac01"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:59.245326 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5c3085db-7ad6-40e2-9212-cd5ae04b38ce req-752d1f46-b06d-4de2-9ea1-e8aeeef6d404 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.246189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5c3085db-7ad6-40e2-9212-cd5ae04b38ce req-752d1f46-b06d-4de2-9ea1-e8aeeef6d404 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.246746 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5c3085db-7ad6-40e2-9212-cd5ae04b38ce req-752d1f46-b06d-4de2-9ea1-e8aeeef6d404 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.259095 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-5c3085db-7ad6-40e2-9212-cd5ae04b38ce req-752d1f46-b06d-4de2-9ea1-e8aeeef6d404 service nova] Creating event network-vif-deleted:59c69492-812b-495a-aa0a-12e25561ac01 for instance 370b9026-ea37-453f-8f94-7e871bc8dd0b on hv-cinder-82002 Sep 13 16:45:59.260713 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ce9cad1eab41efb4da9503c23ad073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6037f42c34be7b2407c258d8885be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:59.264347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-5c3085db-7ad6-40e2-9212-cd5ae04b38ce req-752d1f46-b06d-4de2-9ea1-e8aeeef6d404 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037378 Sep 13 16:45:59.265016 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1878/3765] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:59.270301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-894ebb2c-7d3c-4871-a0ac-2ebc4ec9b7c1 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 200 len: 1511 microversion: 2.1 time: 0.112458 Sep 13 16:45:59.271343 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1888/3766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:59 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:00.295263 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:00.296054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] [instance: 370b9026-ea37-453f-8f94-7e871bc8dd0b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:00.302630 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:00.303142 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:00.303682 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:00.304260 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:00.304709 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:00.305130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:00.318548 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] HTTP exception thrown: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b could not be found. Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Request method failure captured: Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b HTTP/1.1 Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILNJ_Ftfj00JcFYdJxMyCu-XO_vZ65tAxWWTPJcCQ0eFKX9WsjfVXK69tg7dnVYbWrlLJWV0_TnePXZxHspoQUPj9E7OStHUbLmi9cJp5OFMM-UnCVlPS8ObgVBjMWSJXlBYrochtdPFfCfZaDo5jYvqAAn2DiFdQwiO9xhq48HFnMw Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 08f6037f42c34be7b2407c258d8885be Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestMinimumBasicScenario-1135526430 Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:46:00.320388 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/08f6037f42c34be7b2407c258d8885be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/08f6037f42c34be7b2407c258d8885be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/08f6037f42c34be7b2407c258d8885be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_08f6037f42c34be7b2407c258d8885be"}]}] Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestMinimumBasicScenario-1135526430 Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 08f6037f42c34be7b2407c258d8885be Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1135526430 Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-TestMinimumBasicScenario-1135526430-project Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 91ce9cad1eab41efb4da9503c23ad073 Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestMinimumBasicScenario-1135526430-project Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b could not be found. Sep 13 16:46:00.321908 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '370b9026-ea37-453f-8f94-7e871bc8dd0b'} Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b could not be found. Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:00.325807 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b could not be found. Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b could not be found. Sep 13 16:46:00.327140 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:46:00.328415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Returning 404 to user: Instance 370b9026-ea37-453f-8f94-7e871bc8dd0b could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:00.328415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d778224-726f-439e-a231-9292081137e4 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b" status: 404 len: 111 microversion: 2.1 time: 0.031865 Sep 13 16:46:00.328415 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1879/3767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:00 2022] GET /compute/v2.1/servers/370b9026-ea37-453f-8f94-7e871bc8dd0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:00.333092 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b0b6703-a730-49e1-afae-c464d05836e6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] Calling method '.version_select at 0x7fb67c4444c0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:00.356003 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b0b6703-a730-49e1-afae-c464d05836e6 tempest-TestMinimumBasicScenario-1135526430 tempest-TestMinimumBasicScenario-1135526430-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-4394820" status: 202 len: 0 microversion: 2.1 time: 0.028450 Sep 13 16:46:00.356579 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1889/3768] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Sep 13 16:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-4394820 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:46:31.851356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:31.853594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:32.061480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-695c57b5-11f2-4895-8e06-564da8e69536 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Action: 'create', calling method: .version_select at 0x7fb67c146670>, body: {"keypair": {"name": "tempest-TestShelveInstance-850972606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbV1IPhtTy0J5rcw/fSqvTodiR2rdIQ6kddwAWBIi4fc7IZuawUcwgywPC45g16bj0+ZJtynWIZXJW8QyI/FpMP3tpwERzV8u92UwUAdWNUt736cErkcJkJQgiLYxOA1w=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:32.086960 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-695c57b5-11f2-4895-8e06-564da8e69536 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Getting quotas for project 971ad6e8cfa54529a3e6aac596203515. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:32.094310 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-695c57b5-11f2-4895-8e06-564da8e69536 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Getting quotas for user 0e8f8e2bf7f440f291b47dfd9357bc14 and project 971ad6e8cfa54529a3e6aac596203515. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:32.120046 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-695c57b5-11f2-4895-8e06-564da8e69536 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.275007 Sep 13 16:46:32.121018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1880/3769] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Sep 13 16:46:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:45.534200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:45.534976 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:45.539907 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2132753634", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971711683", "security_groups": [{"name": "tempest-secgroup-smoke-1865310243"}], "block_device_mapping_v2": [{"uuid": "78e2bb9c-d887-4a1d-9db2-d26309a11498", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4ea24ff-eba9-4b1b-b236-b6ed3f3d50d9"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:45.654692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] validate_networks() for [('a4ea24ff-eba9-4b1b-b236-b6ed3f3d50d9', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:46:46.032690 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:46:46.033116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:46:46.033586 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:46:46.034269 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:46:46.034680 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:46:46.043518 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.043999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.044434 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.045155 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.045606 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.046038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.063531 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for project 02ef20a5c40945c688b9343861cadb85. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:46.068257 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Getting quotas for user b6417e189b0d467480627cfd38331a9f and project 02ef20a5c40945c688b9343861cadb85. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:46.124037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:46:46.126109 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78e2bb9c-d887-4a1d-9db2-d26309a11498',volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:46.253809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [8fe5a471-edbe-4a63-94f8-18bd2156dea6] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:46:47.262052 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [8fe5a471-edbe-4a63-94f8-18bd2156dea6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 34684. Sep 13 16:46:47.265891 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69579a10-0470-4751-93c6-b6749b2ddf5b tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.733289 Sep 13 16:46:47.266533 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1890/3770] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:46:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:46:47.275130 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:47.276020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:47.279683 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58821a8d-021b-4c71-8f22-d165d5957c5c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:47.280294 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58821a8d-021b-4c71-8f22-d165d5957c5c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:47.337296 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58821a8d-021b-4c71-8f22-d165d5957c5c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:47.344115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58821a8d-021b-4c71-8f22-d165d5957c5c tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1094 microversion: 2.1 time: 0.070480 Sep 13 16:46:47.344686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1881/3771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:47 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:48.367747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e255898-e46e-42ae-9e98-e564dd4547fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:48.368389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e255898-e46e-42ae-9e98-e564dd4547fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:48.425134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8e255898-e46e-42ae-9e98-e564dd4547fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:48.432635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e255898-e46e-42ae-9e98-e564dd4547fd tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1094 microversion: 2.1 time: 0.069464 Sep 13 16:46:48.433187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1891/3772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:48 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:49.455978 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f1110e1-c732-4ff6-87bb-14deaa7b1458 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.456598 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f1110e1-c732-4ff6-87bb-14deaa7b1458 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:49.495297 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-72604282", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-850972606", "security_groups": [{"name": "tempest-secgroup-smoke-1478084194"}], "networks": [{"uuid": "e74bf493-f65e-40f4-a761-2ce1c2dd9316"}], "block_device_mapping_v2": [{"uuid": "517f1b2e-f647-44bd-b8e5-922f47353996", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:49.515729 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f1110e1-c732-4ff6-87bb-14deaa7b1458 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:49.523495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f1110e1-c732-4ff6-87bb-14deaa7b1458 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1094 microversion: 2.1 time: 0.071420 Sep 13 16:46:49.524127 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1882/3773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:49 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:49.619618 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] validate_networks() for [('e74bf493-f65e-40f4-a761-2ce1c2dd9316', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:46:49.977549 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:46:49.977966 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:46:49.978469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:46:49.978870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:46:49.979299 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:46:49.987811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.988278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.988701 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.989918 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.990361 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.990775 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:50.007656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Getting quotas for project 971ad6e8cfa54529a3e6aac596203515. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:50.011339 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Getting quotas for user 0e8f8e2bf7f440f291b47dfd9357bc14 and project 971ad6e8cfa54529a3e6aac596203515. Resources: {'cores', 'ram', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:50.067623 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:46:50.070087 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='517f1b2e-f647-44bd-b8e5-922f47353996',volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:50.198310 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9bad67b-59c6-48fc-a3fa-737c3ba0dcde tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706930 Sep 13 16:46:50.199167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1892/3774] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Sep 13 16:46:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:46:50.210878 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-432a534e-6fb2-422a-bec9-fcd869372353 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:50.211508 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-432a534e-6fb2-422a-bec9-fcd869372353 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:50.266750 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-432a534e-6fb2-422a-bec9-fcd869372353 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:50.274148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-432a534e-6fb2-422a-bec9-fcd869372353 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1086 microversion: 2.1 time: 0.067756 Sep 13 16:46:50.274715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1883/3775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:50 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1086 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:50.547039 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9ae6d1a-025e-4d6c-9296-3c3ab9f18207 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:50.547658 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9ae6d1a-025e-4d6c-9296-3c3ab9f18207 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:50.610139 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9ae6d1a-025e-4d6c-9296-3c3ab9f18207 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:50.617392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9ae6d1a-025e-4d6c-9296-3c3ab9f18207 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1094 microversion: 2.1 time: 0.074461 Sep 13 16:46:50.618051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1893/3776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:50 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:51.299190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:51.300601 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:51.308619 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.309411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.310181 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.311306 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.311981 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.312877 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.392909 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:51.401104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9383c3e-43de-4ad6-a7d3-168f1139cc06 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1202 microversion: 2.1 time: 0.107780 Sep 13 16:46:51.401681 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1884/3777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:51 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1202 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:51.640018 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:51.640572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:51.646998 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.647497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.647935 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.648812 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.649462 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.649896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.751251 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:51.760439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5cbbfdd-686f-407c-a7ed-c6405150abfb tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1144 microversion: 2.1 time: 0.124368 Sep 13 16:46:51.761337 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1894/3778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:51 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1144 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:52.424356 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:52.424980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:52.433090 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:52.434417 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:52.435320 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:52.436249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:52.436843 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:52.437407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:52.696370 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:52.705719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ab96834-6fca-4c3a-bda7-7da6662d42c5 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.284664 Sep 13 16:46:52.706471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1885/3779] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:52 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:52.784478 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:52.785808 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:52.793846 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:52.794698 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:52.796183 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:52.797302 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:52.797979 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:52.798662 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:52.893594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:52.909648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9277952-8ad0-432b-b703-170bdc3cfaa8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1210 microversion: 2.1 time: 0.128757 Sep 13 16:46:52.911401 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1895/3780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:52 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:53.231454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2be8ba5a-4198-48a2-9bdd-3440cd95a5da req-df1b44f5-0197-4e21-a9fb-2622303f224e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:53.244661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2be8ba5a-4198-48a2-9bdd-3440cd95a5da req-df1b44f5-0197-4e21-a9fb-2622303f224e service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.245410 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2be8ba5a-4198-48a2-9bdd-3440cd95a5da req-df1b44f5-0197-4e21-a9fb-2622303f224e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.246189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2be8ba5a-4198-48a2-9bdd-3440cd95a5da req-df1b44f5-0197-4e21-a9fb-2622303f224e service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.260646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2be8ba5a-4198-48a2-9bdd-3440cd95a5da req-df1b44f5-0197-4e21-a9fb-2622303f224e service nova] Creating event network-changed:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:46:53.265692 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2be8ba5a-4198-48a2-9bdd-3440cd95a5da req-df1b44f5-0197-4e21-a9fb-2622303f224e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179353 Sep 13 16:46:53.267010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1886/3781] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:53.730584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:53.731236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:53.737036 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.737509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.737942 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.738625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.739180 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.739667 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.946716 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:53.948354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:53.954594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:53.964018 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.964511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.964949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.965643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.965999 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6bc2055-42ca-4feb-8cdb-ad836ab05bb9 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.238953 Sep 13 16:46:53.966501 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.979184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1896/3782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:53 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:53.979184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6bc0f11f-1877-49cf-b8a8-947b925ea434 req-ec73dd7a-86a1-4f53-b514-353dc6c10b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7288b5-b5ea-4952-879f-41292b4cee93", "tag": "d4f87782-efdc-4ffa-b8aa-aebf0b22938e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:53.980180 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.984026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6bc0f11f-1877-49cf-b8a8-947b925ea434 req-ec73dd7a-86a1-4f53-b514-353dc6c10b15 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.984793 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6bc0f11f-1877-49cf-b8a8-947b925ea434 req-ec73dd7a-86a1-4f53-b514-353dc6c10b15 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.985440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6bc0f11f-1877-49cf-b8a8-947b925ea434 req-ec73dd7a-86a1-4f53-b514-353dc6c10b15 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.998795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6bc0f11f-1877-49cf-b8a8-947b925ea434 req-ec73dd7a-86a1-4f53-b514-353dc6c10b15 service nova] Creating event network-changed:d4f87782-efdc-4ffa-b8aa-aebf0b22938e for instance fd7288b5-b5ea-4952-879f-41292b4cee93 on hv-cinder-82002 Sep 13 16:46:54.004068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6bc0f11f-1877-49cf-b8a8-947b925ea434 req-ec73dd7a-86a1-4f53-b514-353dc6c10b15 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035591 Sep 13 16:46:54.004906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1897/3783] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:54.230098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:54.238039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-762c5d21-1584-4504-8efb-dc739a785ca7 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.304649 Sep 13 16:46:54.238864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1887/3784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:53 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:54.994507 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:54.995319 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:55.001750 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:55.002240 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:55.002682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.003403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:55.003861 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:55.004291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.168059 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:55.176389 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80ef41ba-340d-452c-b163-e4173d25382c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.187178 Sep 13 16:46:55.177688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1898/3785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:54 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:55.262557 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:55.263144 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:55.269480 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:55.269964 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:55.270470 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.271313 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:55.271771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:55.272203 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.405230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:55.413437 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71aa0708-f7fa-458c-84ec-fb57281835e3 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.154867 Sep 13 16:46:55.414003 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1888/3786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:55 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:56.201479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:56.202118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:56.209600 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.210083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.210519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.211231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.211682 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.212107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.342057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:56.350416 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9939fff-4673-40e5-8ab5-07d125848727 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.152788 Sep 13 16:46:56.350996 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1899/3787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:56 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:56.436461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:56.437068 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:56.443392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.443871 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.444309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.444993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.445443 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.445866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.670075 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:56.677798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8292a57-b9e9-41f8-b25b-f2361ca1b669 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.245152 Sep 13 16:46:56.678354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1889/3788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:56 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:57.373430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:57.374031 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:57.381025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:57.381500 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:57.381961 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:57.382641 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:57.383118 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:57.383540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:57.514729 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:57.523032 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd6a26e0-26f6-4677-87a0-3926a8a4fd14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.153412 Sep 13 16:46:57.523595 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1900/3789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:57 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:57.700677 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:57.701194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:57.708589 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:57.709071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:57.709512 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:57.710200 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:57.710653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:57.711115 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:57.840994 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:57.848611 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b559bfef-44b5-4659-a93f-ef05c597b495 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.151816 Sep 13 16:46:57.849169 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1890/3790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:57 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:58.544624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:58.545241 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:58.551672 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:58.552156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:58.552594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:58.553278 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:58.553735 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:58.554163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:58.683168 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:58.690790 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1839f306-877c-41fd-acfe-0eb1f78866db tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.150043 Sep 13 16:46:58.691403 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1901/3791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:58 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:58.871036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:58.871745 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:58.878041 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:58.878550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:58.879026 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:58.879713 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:58.880166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:58.880593 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:59.008949 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:59.018155 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac215dd8-6091-44e4-927e-5c74c696ae02 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.150659 Sep 13 16:46:59.018891 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1891/3792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:58 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:59.714307 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:59.714836 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:59.721174 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:59.721652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:59.722083 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:59.722758 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:59.723236 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:59.723839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:59.856200 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:59.863795 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-33b622bb-cc85-4b05-9c2a-4972be2bff51 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.153386 Sep 13 16:46:59.865137 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1902/3793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:59 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:00.041401 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:00.042020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:00.048511 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:00.048993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:00.049434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:00.050128 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:00.050587 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:00.051037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:00.180572 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:00.188382 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f50f823-cf8b-4177-b0c1-3f6683761944 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.150879 Sep 13 16:47:00.188955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1892/3794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:00 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:00.886863 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:00.887435 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:00.889382 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:00.890074 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=16 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:00.896904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:00.897392 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:00.897831 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:00.898522 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:00.899000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:00.899431 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:01.032964 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:01.041418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf0733e3-9a9d-4004-b993-e37d59e00e14 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.158426 Sep 13 16:47:01.041989 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1903/3795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:00 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:01.212504 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:01.213125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:01.215162 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:01.221062 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:01.221552 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:01.221996 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:01.222701 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:01.223192 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:01.224206 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:01.357927 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:01.365723 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51fae7db-4209-437a-b8b0-ef94af7db5f6 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.157847 Sep 13 16:47:01.366281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1893/3796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:01 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:02.063748 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:02.064366 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:02.070920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:02.071423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:02.071862 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:02.072555 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:02.073020 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:02.073447 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:02.201603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:02.209453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-760f4222-d697-431c-8321-e363f01f1692 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.149547 Sep 13 16:47:02.210037 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1904/3797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:02 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:02.388661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:02.389272 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:02.396487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:02.397077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:02.397635 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:02.398367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:02.398993 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:02.399416 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:02.533488 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:02.541835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c4937bf-63cb-475b-9b2b-0f47f2503659 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.157104 Sep 13 16:47:02.542391 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1894/3798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:02 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:03.234787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:03.235436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:03.242479 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:03.242993 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:03.243437 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:03.244134 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:03.244594 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:03.245022 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:03.382689 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:03.390603 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e5d5dac4-b1f6-40e9-a450-c85c3ba9311f tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.159660 Sep 13 16:47:03.391301 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1905/3799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:03 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:03.425860 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-8af17ab7-d40a-4b76-90db-c4de89abd49b req-9389f203-2f61-47f5-932c-2711a64f5db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "name": "network-vif-plugged", "status": "completed", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:03.437065 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8af17ab7-d40a-4b76-90db-c4de89abd49b req-9389f203-2f61-47f5-932c-2711a64f5db1 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:03.437814 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8af17ab7-d40a-4b76-90db-c4de89abd49b req-9389f203-2f61-47f5-932c-2711a64f5db1 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:03.438368 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8af17ab7-d40a-4b76-90db-c4de89abd49b req-9389f203-2f61-47f5-932c-2711a64f5db1 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:03.451276 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-8af17ab7-d40a-4b76-90db-c4de89abd49b req-9389f203-2f61-47f5-932c-2711a64f5db1 service nova] Creating event network-vif-plugged:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:47:03.456440 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-8af17ab7-d40a-4b76-90db-c4de89abd49b req-9389f203-2f61-47f5-932c-2711a64f5db1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 Sep 13 16:47:03.457083 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1895/3800] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:47:03.564430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:03.565046 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:03.571697 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:03.572188 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:03.572622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:03.573481 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:03.573939 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:03.574359 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:03.777374 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:03.785205 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcb50e41-fcc6-4773-98ba-3ee8c0b7dfba tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.224640 Sep 13 16:47:03.785825 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1906/3801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:03 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:04.414642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:04.415372 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:04.421642 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.422117 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.422547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:04.423249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.423694 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.424113 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:04.560922 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:04.568943 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f700d224-7f31-412b-801c-11a37e6b61e0 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1258 microversion: 2.1 time: 0.159399 Sep 13 16:47:04.569602 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1896/3802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:04 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:04.808184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:04.808796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:04.815184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.815673 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.816116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:04.816811 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.817273 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.817761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:04.945220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:04.952871 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45dbf849-4ae0-4d3e-b9df-f9194495a518 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.148622 Sep 13 16:47:04.953436 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1907/3803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:04 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:05.482362 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-7fb5e1ca-6610-4105-b0a7-94d3869ca782 req-f700952c-a8fa-4cf6-984a-4e6e97d13472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7288b5-b5ea-4952-879f-41292b4cee93", "name": "network-vif-plugged", "status": "completed", "tag": "d4f87782-efdc-4ffa-b8aa-aebf0b22938e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:05.492626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7fb5e1ca-6610-4105-b0a7-94d3869ca782 req-f700952c-a8fa-4cf6-984a-4e6e97d13472 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.493104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7fb5e1ca-6610-4105-b0a7-94d3869ca782 req-f700952c-a8fa-4cf6-984a-4e6e97d13472 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.493535 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7fb5e1ca-6610-4105-b0a7-94d3869ca782 req-f700952c-a8fa-4cf6-984a-4e6e97d13472 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.504167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-7fb5e1ca-6610-4105-b0a7-94d3869ca782 req-f700952c-a8fa-4cf6-984a-4e6e97d13472 service nova] Creating event network-vif-plugged:d4f87782-efdc-4ffa-b8aa-aebf0b22938e for instance fd7288b5-b5ea-4952-879f-41292b4cee93 on hv-cinder-82002 Sep 13 16:47:05.509722 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-7fb5e1ca-6610-4105-b0a7-94d3869ca782 req-f700952c-a8fa-4cf6-984a-4e6e97d13472 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030994 Sep 13 16:47:05.510483 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1897/3804] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:05.591896 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:05.592424 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:05.598580 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.599104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.599541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.600231 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.600676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.601100 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.779610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:05.787847 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1c57765-d250-4b17-abe0-0884833bee03 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1442 microversion: 2.1 time: 0.199889 Sep 13 16:47:05.788428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1908/3805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:05 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1442 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:05.811204 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:05.811899 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:05.817914 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.818384 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.818824 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.819554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.820001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.820420 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.948447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:05.956298 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67359454-dbc8-4d69-875b-3c611aae7539 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1442 microversion: 2.1 time: 0.149243 Sep 13 16:47:05.956861 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1898/3806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:05 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:05.977354 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:05.977974 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:05.984532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.985023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.985466 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.986167 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:05.986625 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:05.987080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:06.225414 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:06.233622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd2c0dc3-69c8-488c-896d-73e0d595c3f8 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1266 microversion: 2.1 time: 0.261244 Sep 13 16:47:06.234246 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1909/3807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:05 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:47:07.257266 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:07.257886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:07.264275 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:07.264761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:07.265199 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:07.265919 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:07.266369 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:07.266798 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:07.728847 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:07.736462 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6b89809-0486-4b8b-9dea-ef7b7b77902e tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1453 microversion: 2.1 time: 0.483908 Sep 13 16:47:07.737027 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1899/3808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:07 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1453 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:07.758747 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:07.759363 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:07.765767 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:07.766259 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:07.766696 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:07.767413 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:07.767860 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:07.768283 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:07.787116 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:07.980110 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:07.990191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-933c6ab7-f53b-45ac-9cf7-fb2fe3fd4b51 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1453 microversion: 2.1 time: 0.235366 Sep 13 16:47:07.990786 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1910/3809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:07 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:08.038299 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-7bef14a2-e8a6-4964-be86-fa7d811439ab req-48634fd6-1896-433b-bdf3-de7b9f1f40fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:08.055037 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7bef14a2-e8a6-4964-be86-fa7d811439ab req-48634fd6-1896-433b-bdf3-de7b9f1f40fc service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:08.055802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7bef14a2-e8a6-4964-be86-fa7d811439ab req-48634fd6-1896-433b-bdf3-de7b9f1f40fc service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:08.056334 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7bef14a2-e8a6-4964-be86-fa7d811439ab req-48634fd6-1896-433b-bdf3-de7b9f1f40fc service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:08.070264 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-7bef14a2-e8a6-4964-be86-fa7d811439ab req-48634fd6-1896-433b-bdf3-de7b9f1f40fc service nova] Creating event network-changed:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:47:08.075533 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-7bef14a2-e8a6-4964-be86-fa7d811439ab req-48634fd6-1896-433b-bdf3-de7b9f1f40fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043718 Sep 13 16:47:08.076350 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1900/3810] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:10.096824 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-b4fecfdf-fb3b-4542-9e9c-58fdb6abcb23 req-382beb9d-6d3e-4dff-b0c4-3ec0574e1a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7288b5-b5ea-4952-879f-41292b4cee93", "tag": "d4f87782-efdc-4ffa-b8aa-aebf0b22938e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:10.106429 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b4fecfdf-fb3b-4542-9e9c-58fdb6abcb23 req-382beb9d-6d3e-4dff-b0c4-3ec0574e1a24 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:10.106954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b4fecfdf-fb3b-4542-9e9c-58fdb6abcb23 req-382beb9d-6d3e-4dff-b0c4-3ec0574e1a24 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:10.107391 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b4fecfdf-fb3b-4542-9e9c-58fdb6abcb23 req-382beb9d-6d3e-4dff-b0c4-3ec0574e1a24 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:10.118990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-b4fecfdf-fb3b-4542-9e9c-58fdb6abcb23 req-382beb9d-6d3e-4dff-b0c4-3ec0574e1a24 service nova] Creating event network-changed:d4f87782-efdc-4ffa-b8aa-aebf0b22938e for instance fd7288b5-b5ea-4952-879f-41292b4cee93 on hv-cinder-82002 Sep 13 16:47:10.123991 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-b4fecfdf-fb3b-4542-9e9c-58fdb6abcb23 req-382beb9d-6d3e-4dff-b0c4-3ec0574e1a24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031012 Sep 13 16:47:10.124584 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1911/3811] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:38.349884 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=46 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:38.350702 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:38.352184 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:48:38.352331 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 (ip 10.222.0.50) !!! Sep 13 16:48:38.355688 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:38.356948 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:38.360680 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:38.361354 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:38.371782 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.372367 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.372882 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.373663 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.374194 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.374634 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.406054 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:48:38.494030 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf60abe1-360e-48ed-bb58-ed68a1fe2b2f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 204 len: 0 microversion: 2.1 time: 0.146207 Sep 13 16:48:38.495608 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c9c136a8-b052-42e3-8ea1-31123e8be605 req-11b9300f-d9b4-4755-87d8-28b3ccc4b3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7288b5-b5ea-4952-879f-41292b4cee93", "tag": "d4f87782-efdc-4ffa-b8aa-aebf0b22938e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:38.498010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1901/3812] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:48:38 2022] DELETE /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:48:38.503407 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:38.504187 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:38.506626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c9c136a8-b052-42e3-8ea1-31123e8be605 req-11b9300f-d9b4-4755-87d8-28b3ccc4b3f6 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.507851 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c9c136a8-b052-42e3-8ea1-31123e8be605 req-11b9300f-d9b4-4755-87d8-28b3ccc4b3f6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.508635 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c9c136a8-b052-42e3-8ea1-31123e8be605 req-11b9300f-d9b4-4755-87d8-28b3ccc4b3f6 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.511281 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.511837 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.513094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.513222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.513719 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.514214 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.520080 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c9c136a8-b052-42e3-8ea1-31123e8be605 req-11b9300f-d9b4-4755-87d8-28b3ccc4b3f6 service nova] Creating event network-changed:d4f87782-efdc-4ffa-b8aa-aebf0b22938e for instance fd7288b5-b5ea-4952-879f-41292b4cee93 on hv-cinder-82002 Sep 13 16:48:38.525185 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c9c136a8-b052-42e3-8ea1-31123e8be605 req-11b9300f-d9b4-4755-87d8-28b3ccc4b3f6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174643 Sep 13 16:48:38.525985 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1912/3813] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:38.725854 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:38.733652 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc190cb9-db8f-4b5f-b82e-53414bec98ef tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1578 microversion: 2.1 time: 0.234380 Sep 13 16:48:38.734211 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1902/3814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:38 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:39.758267 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:39.758981 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:39.765149 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.765626 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.766058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.766732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.767220 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.767638 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.996787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:40.004440 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c358b1b2-a598-40d3-a05c-90e071a70b31 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1578 microversion: 2.1 time: 0.251175 Sep 13 16:48:40.005000 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1913/3815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:39 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1578 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:40.599167 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-df3461b5-4b7e-4286-83fa-ae2b5edfb4c3 req-87f73f3b-b82b-48f9-9609-2a553e15ebbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7288b5-b5ea-4952-879f-41292b4cee93", "name": "network-vif-deleted", "tag": "d4f87782-efdc-4ffa-b8aa-aebf0b22938e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:40.608944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-df3461b5-4b7e-4286-83fa-ae2b5edfb4c3 req-87f73f3b-b82b-48f9-9609-2a553e15ebbf service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:40.609434 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-df3461b5-4b7e-4286-83fa-ae2b5edfb4c3 req-87f73f3b-b82b-48f9-9609-2a553e15ebbf service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:40.609907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-df3461b5-4b7e-4286-83fa-ae2b5edfb4c3 req-87f73f3b-b82b-48f9-9609-2a553e15ebbf service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:40.622544 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-df3461b5-4b7e-4286-83fa-ae2b5edfb4c3 req-87f73f3b-b82b-48f9-9609-2a553e15ebbf service nova] Creating event network-vif-deleted:d4f87782-efdc-4ffa-b8aa-aebf0b22938e for instance fd7288b5-b5ea-4952-879f-41292b4cee93 on hv-cinder-82002 Sep 13 16:48:40.627225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-df3461b5-4b7e-4286-83fa-ae2b5edfb4c3 req-87f73f3b-b82b-48f9-9609-2a553e15ebbf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 Sep 13 16:48:40.627815 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1903/3816] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:41.028345 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:41.029028 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:41.035509 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.036058 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.036578 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.037323 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.038304 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.038930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.070820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.071342 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.071778 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.072218 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lazy-loading 'fault' on Instance uuid fd7288b5-b5ea-4952-879f-41292b4cee93 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:48:41.113369 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:41.121782 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48fc55df-5ce2-42e7-8829-bbafa907de88 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 200 len: 1230 microversion: 2.1 time: 0.097273 Sep 13 16:48:41.122291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1914/3817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:41 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:42.145255 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:42.145955 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: fd7288b5-b5ea-4952-879f-41292b4cee93] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:42.152165 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.152647 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.153086 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.153765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.154218 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.154643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.167645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] HTTP exception thrown: Instance fd7288b5-b5ea-4952-879f-41292b4cee93 could not be found. Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Request method failure captured: Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 HTTP/1.1 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILLNN-U4XAei_Yng_n-QZPRmOiEDql80aC1gcfPPImtpCUb6iaSxrEmAqFUmPN1cSrCHkIvKg-KvStIoKmeAs_AFK1IsZc5VPec5fIGKjnQRMlwIvaMX76AF2ot91I52EP5DliH3VTJE2KKMKJcY7Z2m8Pk5fBq5QE8oVXP2gOUaVm8 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:48:42.169239 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_02ef20a5c40945c688b9343861cadb85"}]}] Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: b6417e189b0d467480627cfd38331a9f Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance fd7288b5-b5ea-4952-879f-41292b4cee93 could not be found. Sep 13 16:48:42.170836 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'fd7288b5-b5ea-4952-879f-41292b4cee93'} Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7288b5-b5ea-4952-879f-41292b4cee93 could not be found. Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:42.171765 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7288b5-b5ea-4952-879f-41292b4cee93 could not be found. Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7288b5-b5ea-4952-879f-41292b4cee93 could not be found. Sep 13 16:48:42.173070 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.174230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Returning 404 to user: Instance fd7288b5-b5ea-4952-879f-41292b4cee93 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:42.174230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff0ddfe1-7a8a-4e95-babf-0574b7a8b21f tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93" status: 404 len: 111 microversion: 2.1 time: 0.029975 Sep 13 16:48:42.174230 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1904/3818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:42 2022] GET /compute/v2.1/servers/fd7288b5-b5ea-4952-879f-41292b4cee93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:48:45.222588 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:45.223216 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:45.224727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ef076f55-f101-4a6f-a717-c81b16472b3d req-6e40d895-b061-497f-9d8a-408e485b11db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1194dded-20ab-4b67-b5a2-cd714bc137ed", "tag": "07e5f6b4-51b5-4632-833a-2a590eb31df4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:45.231191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.231757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.232260 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.233025 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.233539 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.234195 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.238219 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ef076f55-f101-4a6f-a717-c81b16472b3d req-6e40d895-b061-497f-9d8a-408e485b11db service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.239010 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ef076f55-f101-4a6f-a717-c81b16472b3d req-6e40d895-b061-497f-9d8a-408e485b11db service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.239447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ef076f55-f101-4a6f-a717-c81b16472b3d req-6e40d895-b061-497f-9d8a-408e485b11db service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.250802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ef076f55-f101-4a6f-a717-c81b16472b3d req-6e40d895-b061-497f-9d8a-408e485b11db service nova] Creating event network-changed:07e5f6b4-51b5-4632-833a-2a590eb31df4 for instance 1194dded-20ab-4b67-b5a2-cd714bc137ed on hv-cinder-82002 Sep 13 16:48:45.256094 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ef076f55-f101-4a6f-a717-c81b16472b3d req-6e40d895-b061-497f-9d8a-408e485b11db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035213 Sep 13 16:48:45.256686 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1905/3819] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:48:45.262232 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:48:45.354919 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1877e623-9064-4423-9435-55a27d272e52 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 204 len: 0 microversion: 2.1 time: 0.136064 Sep 13 16:48:45.355799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1915/3820] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:48:45 2022] DELETE /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:48:45.365698 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:45.366813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:45.373986 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.374514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.375134 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.375832 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.376279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.376918 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.513540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:45.521295 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d42ffed-c260-4bfd-bb0c-129396f8e559 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1578 microversion: 2.1 time: 0.161094 Sep 13 16:48:45.521866 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1906/3821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:45 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:46.546291 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:46.547015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:46.553346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:46.553763 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:46.554288 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:46.555064 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:46.555519 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:46.555951 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:46.691423 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:46.699214 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-44d3b349-7a0a-4b4a-b33b-1b71c2ba0cb0 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1578 microversion: 2.1 time: 0.157148 Sep 13 16:48:46.699804 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1916/3822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:46 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:47.286740 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-7b01a778-53d4-4cbd-b90f-a18c4ffeeb8a req-f7b9c2df-ff93-4076-bb44-57c947c48a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1194dded-20ab-4b67-b5a2-cd714bc137ed", "name": "network-vif-deleted", "tag": "07e5f6b4-51b5-4632-833a-2a590eb31df4"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:47.298077 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7b01a778-53d4-4cbd-b90f-a18c4ffeeb8a req-f7b9c2df-ff93-4076-bb44-57c947c48a62 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:47.298550 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7b01a778-53d4-4cbd-b90f-a18c4ffeeb8a req-f7b9c2df-ff93-4076-bb44-57c947c48a62 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:47.299014 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7b01a778-53d4-4cbd-b90f-a18c4ffeeb8a req-f7b9c2df-ff93-4076-bb44-57c947c48a62 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:47.311974 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-7b01a778-53d4-4cbd-b90f-a18c4ffeeb8a req-f7b9c2df-ff93-4076-bb44-57c947c48a62 service nova] Creating event network-vif-deleted:07e5f6b4-51b5-4632-833a-2a590eb31df4 for instance 1194dded-20ab-4b67-b5a2-cd714bc137ed on hv-cinder-82002 Sep 13 16:48:47.316738 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-7b01a778-53d4-4cbd-b90f-a18c4ffeeb8a req-f7b9c2df-ff93-4076-bb44-57c947c48a62 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Sep 13 16:48:47.317319 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1907/3823] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:47.723312 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:47.724014 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:47.730418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:47.730934 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:47.731375 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:47.732071 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:47.732528 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:47.732959 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:47.762848 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:47.763293 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:47.763734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:47.764179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lazy-loading 'fault' on Instance uuid 1194dded-20ab-4b67-b5a2-cd714bc137ed {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:48:47.804622 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6417e189b0d467480627cfd38331a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ef20a5c40945c688b9343861cadb85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:47.812380 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9151a15-c9d1-43a4-be5d-71f01897fadc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 200 len: 1230 microversion: 2.1 time: 0.093049 Sep 13 16:48:47.812968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1917/3824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:47 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:48.836562 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:48.837835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: 1194dded-20ab-4b67-b5a2-cd714bc137ed] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:48.844125 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:48.844604 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:48.845043 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:48.845771 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:48.846224 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:48.846645 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:48.860309 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] HTTP exception thrown: Instance 1194dded-20ab-4b67-b5a2-cd714bc137ed could not be found. Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Request method failure captured: Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed HTTP/1.1 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILLNN-U4XAei_Yng_n-QZPRmOiEDql80aC1gcfPPImtpCUb6iaSxrEmAqFUmPN1cSrCHkIvKg-KvStIoKmeAs_AFK1IsZc5VPec5fIGKjnQRMlwIvaMX76AF2ot91I52EP5DliH3VTJE2KKMKJcY7Z2m8Pk5fBq5QE8oVXP2gOUaVm8 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:48:48.861907 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_02ef20a5c40945c688b9343861cadb85"}]}] Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: b6417e189b0d467480627cfd38331a9f Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance 1194dded-20ab-4b67-b5a2-cd714bc137ed could not be found. Sep 13 16:48:48.863476 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': '1194dded-20ab-4b67-b5a2-cd714bc137ed'} Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1194dded-20ab-4b67-b5a2-cd714bc137ed could not be found. Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:48.864355 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1194dded-20ab-4b67-b5a2-cd714bc137ed could not be found. Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1194dded-20ab-4b67-b5a2-cd714bc137ed could not be found. Sep 13 16:48:48.865761 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:48.867072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Returning 404 to user: Instance 1194dded-20ab-4b67-b5a2-cd714bc137ed could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:48.867072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b671ebc-bde1-4213-b046-43d4ec5990ae tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed" status: 404 len: 111 microversion: 2.1 time: 0.031586 Sep 13 16:48:48.867072 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1908/3825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:48 2022] GET /compute/v2.1/servers/1194dded-20ab-4b67-b5a2-cd714bc137ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:48:49.292652 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:49.293176 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:49.299532 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:49.300015 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:49.300445 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:49.301125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:49.301571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:49.301990 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:49.315444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] HTTP exception thrown: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Request method failure captured: Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca HTTP/1.1 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Connection: close Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Host: 10.222.0.50 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjILLNN-U4XAei_Yng_n-QZPRmOiEDql80aC1gcfPPImtpCUb6iaSxrEmAqFUmPN1cSrCHkIvKg-KvStIoKmeAs_AFK1IsZc5VPec5fIGKjnQRMlwIvaMX76AF2ot91I52EP5DliH3VTJE2KKMKJcY7Z2m8Pk5fBq5QE8oVXP2gOUaVm8 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 13 16:48:49.317047 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_02ef20a5c40945c688b9343861cadb85"}]}] Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Id: b6417e189b0d467480627cfd38331a9f Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: method: > Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: exception: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.318540 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: action_args: {'id': 'b91b7693-40ea-4802-af89-489aa88bd4ca'} Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:49.319418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.320650 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.322511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Returning 404 to user: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:49.322511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4c35e85-f9c4-48ef-869d-30f3ae00a460 tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 404 len: 111 microversion: 2.1 time: 0.029874 Sep 13 16:48:49.322511 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1918/3826] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:48:49 2022] DELETE /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:48:49.328189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:49.328803 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] [instance: b91b7693-40ea-4802-af89-489aa88bd4ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:49.334987 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:49.335475 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:49.335916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:49.336605 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:49.337766 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:49.338337 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:49.353524 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] HTTP exception thrown: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Request method failure captured: Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca HTTP/1.1 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILLNN-U4XAei_Yng_n-QZPRmOiEDql80aC1gcfPPImtpCUb6iaSxrEmAqFUmPN1cSrCHkIvKg-KvStIoKmeAs_AFK1IsZc5VPec5fIGKjnQRMlwIvaMX76AF2ot91I52EP5DliH3VTJE2KKMKJcY7Z2m8Pk5fBq5QE8oVXP2gOUaVm8 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:48:49.355058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/02ef20a5c40945c688b9343861cadb85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_02ef20a5c40945c688b9343861cadb85"}]}] Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 02ef20a5c40945c688b9343861cadb85 Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-473989783 Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: b6417e189b0d467480627cfd38331a9f Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-473989783-project Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.356540 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'b91b7693-40ea-4802-af89-489aa88bd4ca'} Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:49.357392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. Sep 13 16:48:49.358759 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:48:49.360040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Returning 404 to user: Instance b91b7693-40ea-4802-af89-489aa88bd4ca could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:49.360040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78e5899a-6689-40c1-8b1e-5c49d979b0bc tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca" status: 404 len: 111 microversion: 2.1 time: 0.032275 Sep 13 16:48:49.360040 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1909/3827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:49 2022] GET /compute/v2.1/servers/b91b7693-40ea-4802-af89-489aa88bd4ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:48:50.655940 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-088f5b75-4f90-48a8-806b-ea32650052ed tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] Calling method '.version_select at 0x7fb67c0f21f0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:50.675954 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-088f5b75-4f90-48a8-806b-ea32650052ed tempest-TestVolumeBootPattern-473989783 tempest-TestVolumeBootPattern-473989783-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-971711683" status: 202 len: 0 microversion: 2.1 time: 0.023800 Sep 13 16:48:50.676610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1919/3828] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Sep 13 16:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-971711683 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:49:00.130961 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:00.131499 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:00.134141 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:00.134813 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:00.141009 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:00.141487 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:00.141924 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:00.142606 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:00.143097 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:00.143523 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:00.167916 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lazy-loading 'flavor' on Instance uuid feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:49:00.236447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99fe4383-7a4f-4923-8ef3-488597879f8e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "POST /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf/action" status: 202 len: 0 microversion: 2.1 time: 0.109209 Sep 13 16:49:00.237020 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1910/3829] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:49:00 2022] POST /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:49:00.242692 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:00.246676 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:00.247330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:00.254718 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:00.255224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:00.255671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:00.256365 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:00.256819 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:00.257248 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:00.390321 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:00.398065 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4bb6644a-7d96-4a8f-abce-3030ef43ed1a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.156880 Sep 13 16:49:00.398627 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1920/3830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:00 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:01.422869 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:01.423596 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:01.429728 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:01.430212 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:01.431254 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:01.432099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:01.432554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:01.432985 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:01.566576 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:01.575348 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca7dda74-4c59-4d36-b028-1f5cb39c21f2 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.157239 Sep 13 16:49:01.575896 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1911/3831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:01 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:02.598504 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:02.599143 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:02.606430 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.606920 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.607364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:02.608049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.608501 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.608925 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:02.742070 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:02.750428 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa9d1477-cc53-4383-bd9a-d059cfc46ca3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.156021 Sep 13 16:49:02.751026 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1921/3832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:02 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:03.774088 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:03.774704 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:03.781174 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:03.781653 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:03.782087 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:03.782773 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:03.783249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:03.783672 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:03.910495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:03.918812 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e09f5e38-fb44-4278-a697-938d9d61853a tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.148605 Sep 13 16:49:03.919398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1912/3833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:03 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:04.941538 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:04.942057 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:04.948971 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:04.949446 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:04.949879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:04.950590 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:04.951068 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:04.951493 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:05.085949 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:05.094453 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf95ff4d-53ff-4fcf-9b70-ec088a490100 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.156879 Sep 13 16:49:05.095038 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1922/3834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:04 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:06.117442 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:06.118207 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:06.124411 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:06.124898 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:06.125341 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:06.126036 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:06.126490 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:06.126937 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:06.252495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:06.260191 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4f61484f-8139-4f37-8809-c6f7ea5d7711 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.146794 Sep 13 16:49:06.260757 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1913/3835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:06 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:07.283647 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:07.284184 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:07.291576 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.292050 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.292484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.293160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.293605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.294023 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.424275 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:07.436104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34ed59f0-a8fd-4c94-9757-5a4ce994003e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.156446 Sep 13 16:49:07.436670 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1923/3836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:07 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:08.460679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:08.461284 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:08.468146 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.468625 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.469116 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.469804 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.470252 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.470678 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.602484 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:08.610186 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61098472-0da7-410f-802b-880ba829d65d tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.153383 Sep 13 16:49:08.610736 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1914/3837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:08 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:09.632544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:09.633157 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:09.635547 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:09.640797 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:09.641287 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:09.641725 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:09.642418 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:09.642870 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:09.643324 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:09.773104 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:09.780930 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1e3e4a3-f8c7-4cdd-afaf-0d21e5308e20 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.152476 Sep 13 16:49:09.781497 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1924/3838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:09 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:10.803646 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:10.804262 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:10.811594 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:10.812078 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:10.812530 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.813225 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:10.813679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:10.814104 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.980551 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:10.988166 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63102cfe-14b5-476a-971e-749c343a77a1 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.188351 Sep 13 16:49:10.988727 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1915/3839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:10 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:12.011577 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:12.012186 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:12.018589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:12.019107 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:12.019544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:12.020219 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:12.020671 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:12.021089 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:12.148856 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:12.157009 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-083a8850-4aa0-40f5-98ed-e280eeeec9de tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.149498 Sep 13 16:49:12.157571 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1925/3840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:12 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:13.181060 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:13.181730 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:13.187992 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.188471 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.188906 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.189591 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.190039 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.190461 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.322153 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:13.329802 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5aeb0180-f91d-487f-b459-acbc984c81f3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1508 microversion: 2.1 time: 0.153346 Sep 13 16:49:13.330636 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1916/3841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:13 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:13.353187 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:13.353887 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:13.360160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.360634 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.361062 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.361736 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.362181 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.362599 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.538968 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120638) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 16:49:13.607090 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3339454c-86eb-49a5-8199-e5652bc95156 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "POST /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf/action" status: 202 len: 0 microversion: 2.1 time: 0.258369 Sep 13 16:49:13.609213 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1926/3842] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Sep 13 16:49:13 2022] POST /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:49:13.615835 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:13.616445 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:13.622547 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.623058 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.623495 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.624189 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.624644 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.625071 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.787190 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:13.795687 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b32f5d37-6160-4c47-af54-de1696a7d817 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1516 microversion: 2.1 time: 0.183675 Sep 13 16:49:13.796249 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1917/3843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:13 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:14.819266 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:14.819872 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:14.826541 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.827049 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.827484 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:14.828165 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.828610 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.829030 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:14.968346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:14.976734 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-64600cff-0abe-42f2-a443-3cfb87cba8b7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1518 microversion: 2.1 time: 0.161682 Sep 13 16:49:14.978061 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1927/3844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:14 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:16.001795 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:16.002643 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:16.012138 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.012823 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.013503 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:16.014393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.015074 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.015517 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:16.102820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-77ebeb53-156b-4ed7-a149-c47853dc40eb req-32c6f2b0-492f-41c4-9ae3-7acefece2391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:16.112799 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-77ebeb53-156b-4ed7-a149-c47853dc40eb req-32c6f2b0-492f-41c4-9ae3-7acefece2391 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.113346 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-77ebeb53-156b-4ed7-a149-c47853dc40eb req-32c6f2b0-492f-41c4-9ae3-7acefece2391 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.113787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-77ebeb53-156b-4ed7-a149-c47853dc40eb req-32c6f2b0-492f-41c4-9ae3-7acefece2391 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:16.125787 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-77ebeb53-156b-4ed7-a149-c47853dc40eb req-32c6f2b0-492f-41c4-9ae3-7acefece2391 service nova] Creating event network-vif-unplugged:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:49:16.130809 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-77ebeb53-156b-4ed7-a149-c47853dc40eb req-32c6f2b0-492f-41c4-9ae3-7acefece2391 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109987 Sep 13 16:49:16.131438 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1928/3845] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:49:16.176925 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:16.185311 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8edad42-fe8a-4868-902d-34965d7cbcf6 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.188058 Sep 13 16:49:16.185864 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1918/3846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:15 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:17.209512 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:17.210201 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:17.218761 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:17.219572 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:17.220332 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:17.221467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:17.222224 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:17.223016 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:17.370927 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:17.380605 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1e76823-850f-417a-a254-f400d0c9ced3 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.176362 Sep 13 16:49:17.381415 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1929/3847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:17 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:18.404886 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:18.405493 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:18.411901 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.412363 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.412799 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.413477 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.413923 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.414344 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.544626 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:18.552231 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82472b69-88ab-4606-906f-d162ff8eda1e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.151791 Sep 13 16:49:18.552806 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1919/3848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:18 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:19.575193 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:19.575796 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:19.582648 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:19.583153 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:19.583589 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:19.584264 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:19.584711 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:19.585128 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:19.713163 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:19.721544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a2be4c5-f613-41c5-b16e-d5b435e1366c tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.150911 Sep 13 16:49:19.722111 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1930/3849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:19 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:20.744819 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:20.745452 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:20.752098 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:20.752571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:20.753001 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:20.753679 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:20.754123 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:20.754543 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:20.882980 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:20.891830 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef6073f7-d012-4d1c-ad28-8edeb8e528f7 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.150874 Sep 13 16:49:20.892396 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1920/3850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:20 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:21.915357 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:21.916012 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:21.922239 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:21.922719 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:21.923191 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:21.923879 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:21.924330 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:21.924754 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:22.068876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:22.076869 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b77fbadc-ca42-43e1-9127-75bcd8349036 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.165311 Sep 13 16:49:22.077439 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1931/3851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:21 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:23.100392 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:23.101006 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:23.108148 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.108662 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.109099 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.109785 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.110238 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.110661 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.242101 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:23.250347 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba503e07-8362-4fdf-955e-e684001c3111 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1574 microversion: 2.1 time: 0.153819 Sep 13 16:49:23.250934 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1921/3852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:23 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:24.272923 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:24.273543 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:24.280212 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:24.280704 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:24.281156 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:24.281838 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:24.282295 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:24.282724 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:24.414467 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:24.422876 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c616cd79-cb14-46b8-bd5e-501ad5e3a987 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1561 microversion: 2.1 time: 0.153833 Sep 13 16:49:24.423469 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1932/3853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:24 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:26.134439 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-32ef3b32-56ee-4188-a99d-c9654b64dc38 req-c29a3e17-a9f8-4255-bc81-82307c440a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "name": "network-vif-plugged", "status": "completed", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:26.144387 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-32ef3b32-56ee-4188-a99d-c9654b64dc38 req-c29a3e17-a9f8-4255-bc81-82307c440a50 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.144868 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-32ef3b32-56ee-4188-a99d-c9654b64dc38 req-c29a3e17-a9f8-4255-bc81-82307c440a50 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.145291 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-32ef3b32-56ee-4188-a99d-c9654b64dc38 req-c29a3e17-a9f8-4255-bc81-82307c440a50 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.156944 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-32ef3b32-56ee-4188-a99d-c9654b64dc38 req-c29a3e17-a9f8-4255-bc81-82307c440a50 service nova] Creating event network-vif-plugged:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:49:26.161820 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-32ef3b32-56ee-4188-a99d-c9654b64dc38 req-c29a3e17-a9f8-4255-bc81-82307c440a50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031001 Sep 13 16:49:26.162409 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1922/3854] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:34.897924 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:34.900010 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:34.901000 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:34.901889 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:34.902874 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:50:34.903023 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Tue Sep 13 16:50:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Sep 13 16:50:34.907757 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:34.908261 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:34.909399 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-5377d6b4-8e86-4433-a883-080f638ff7c6 req-44bfa95f-25cb-416c-a16a-22272b9ac110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:34.917788 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.918597 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.918722 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:34.921408 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.921906 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.922341 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:34.925398 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5377d6b4-8e86-4433-a883-080f638ff7c6 req-44bfa95f-25cb-416c-a16a-22272b9ac110 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.926496 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5377d6b4-8e86-4433-a883-080f638ff7c6 req-44bfa95f-25cb-416c-a16a-22272b9ac110 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.927454 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5377d6b4-8e86-4433-a883-080f638ff7c6 req-44bfa95f-25cb-416c-a16a-22272b9ac110 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:34.944063 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-5377d6b4-8e86-4433-a883-080f638ff7c6 req-44bfa95f-25cb-416c-a16a-22272b9ac110 service nova] Creating event network-changed:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:50:34.949527 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-5377d6b4-8e86-4433-a883-080f638ff7c6 req-44bfa95f-25cb-416c-a16a-22272b9ac110 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051004 Sep 13 16:50:34.950131 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1923/3855] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:34.958732 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:50:35.057252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95cd6949-03cf-4fc2-8738-c98ede14582e tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "DELETE /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 204 len: 0 microversion: 2.1 time: 0.160744 Sep 13 16:50:35.059002 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1933/3856] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Sep 13 16:50:34 2022] DELETE /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:50:35.070048 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:35.070421 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:35.077846 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:35.078336 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:35.078774 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:35.079514 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:35.080222 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:35.080651 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:35.234217 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:35.241876 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf151209-6594-4903-b440-2049c3329046 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.176886 Sep 13 16:50:35.242447 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1924/3857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:35 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:36.266820 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:36.267544 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:36.274179 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.274656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.275125 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.275806 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.276252 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.276702 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.430922 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:36.439160 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0568ed8b-f710-4f3a-9d58-3c67a7e49126 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1567 microversion: 2.1 time: 0.177236 Sep 13 16:50:36.439742 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1934/3858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:36 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:37.004502 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c32eb8e1-effb-4b6b-8889-c8d9271b45aa req-9f2e747d-e906-4bbf-a76c-332217ed1673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf", "name": "network-vif-deleted", "tag": "5fc50934-2b33-4e25-adee-e358e646f069"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:37.016656 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c32eb8e1-effb-4b6b-8889-c8d9271b45aa req-9f2e747d-e906-4bbf-a76c-332217ed1673 service nova] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.017139 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c32eb8e1-effb-4b6b-8889-c8d9271b45aa req-9f2e747d-e906-4bbf-a76c-332217ed1673 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.017571 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c32eb8e1-effb-4b6b-8889-c8d9271b45aa req-9f2e747d-e906-4bbf-a76c-332217ed1673 service nova] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.032324 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c32eb8e1-effb-4b6b-8889-c8d9271b45aa req-9f2e747d-e906-4bbf-a76c-332217ed1673 service nova] Creating event network-vif-deleted:5fc50934-2b33-4e25-adee-e358e646f069 for instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf on hv-cinder-82002 Sep 13 16:50:37.037787 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c32eb8e1-effb-4b6b-8889-c8d9271b45aa req-9f2e747d-e906-4bbf-a76c-332217ed1673 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037855 Sep 13 16:50:37.038393 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1925/3859] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:37.461679 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:37.462364 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:37.468904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.469396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.469835 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.470564 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.471017 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.471444 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.502888 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.503396 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.503839 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.504286 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lazy-loading 'fault' on Instance uuid feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:50:37.545336 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8f8e2bf7f440f291b47dfd9357bc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ad6e8cfa54529a3e6aac596203515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:37.553624 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f4db653-09d3-4713-a722-83dde200273b tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 200 len: 1222 microversion: 2.1 time: 0.095785 Sep 13 16:50:37.554196 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1935/3860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:37 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:38.578561 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:38.579279 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] [instance: feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:38.585715 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:38.586201 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:38.586637 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:38.587346 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Acquiring lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:38.587800 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:38.588228 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Lock "3524178c-5c28-4931-8ce8-d0486ae70a8d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:38.601856 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] HTTP exception thrown: Instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf could not be found. Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Request method failure captured: Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf HTTP/1.1 Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Connection: close Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Host: 10.222.0.50 Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjILPiaxaqYBTiYEuGB9ysbjsgP8ZBhlQbsJlOE1F5ShB0Lv8zcGW5Eyl8fr07068NUSGy7kUerLsXdo5ihF7VhWBfG6I5GmbeH3fdqP85msbsfCuXQs7sDYxKVCNF0MAkU-zYwxZLyxK7UJ8Rk9GVuedxkXoPSI1Gja-bfmzgR4ixIpE Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Id: 971ad6e8cfa54529a3e6aac596203515 Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestShelveInstance-964893609 Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 13 16:50:38.603481 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/971ad6e8cfa54529a3e6aac596203515"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/971ad6e8cfa54529a3e6aac596203515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/971ad6e8cfa54529a3e6aac596203515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_971ad6e8cfa54529a3e6aac596203515"}]}] Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestShelveInstance-964893609 Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 971ad6e8cfa54529a3e6aac596203515 Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestShelveInstance-964893609 Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User: tempest-TestShelveInstance-964893609-project Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Id: 0e8f8e2bf7f440f291b47dfd9357bc14 Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestShelveInstance-964893609-project Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: method: > Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: exception: Instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf could not be found. Sep 13 16:50:38.605061 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: action_args: {'id': 'feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf'} Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf could not be found. Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:50:38.606069 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf could not be found. Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf could not be found. Sep 13 16:50:38.607554 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 13 16:50:38.609025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Returning 404 to user: Instance feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:50:38.609025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63b489ae-6f0a-402e-bba1-9e58efa64473 tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf" status: 404 len: 111 microversion: 2.1 time: 0.031666 Sep 13 16:50:38.609025 dv-cinder-820027-28-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1926/3861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:38 2022] GET /compute/v2.1/servers/feb3a68a-bd2e-4e5a-9f26-4f7e453ddbbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:50:38.767051 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab0caed6-1c57-4341-9824-434626b7efbe tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] Calling method '.version_select at 0x7fb67cf09c10>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:38.785904 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab0caed6-1c57-4341-9824-434626b7efbe tempest-TestShelveInstance-964893609 tempest-TestShelveInstance-964893609-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-850972606" status: 202 len: 0 microversion: 2.1 time: 0.023373 Sep 13 16:50:38.786656 dv-cinder-820027-28-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1936/3862] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Sep 13 16:50:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-850972606 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)